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This paper preSents one module in a series of resource materials ^ 
which are designed , for use by teach'er educators . The genesis for these 
mate'riaj.s Is in the ten "clusters of capabilities," outlined in the x 
pap^r* "A Common Body of Practice for Teachers: The Challenge of 
Public Law 94-142^ to Teacher Education", which form the H>ropbged core 
of professional knowledge needed by professional teachers who will 

practice in the world of tomorrow, ' The resource materials are to be 

' . .■ * 

used by teacher educators to reexamine andanhance their current practice 



in preparing ilassroom teachers to .work competently and comfo*rtably 
with children who have a wide range of iridividual needs. Each module 
provides further Elaboration , of a specified "cluster of capabilities" 
ii\ this cage •.^R^ferralt Formal, observation of students^ social; be- 
havior* . 



Bxtendlhg the Challenge: * , 

Working Toward a Common Body of Practice for Teachers 

^ ... . ■. 

Concerned educators 'have always wrestled with Issues of excellence 
and iprof es^ional (development • It ±s argued, In the paper "A Common Body 
of Practice ^or Teachers: Th^ Challenge of Public Law 94-142 to' Teacher ^ 
.Education/' that the Education for All Handicapped Children Act of 1975 
provides the necessary Impetus for a concerted reexamination of teacher 
educ%:lon. ^*urther, it is. argued that this reexamiaatiori should enhance 

the process of establishing a body of knowledge common to. the members of 

\- ■ . 

the teaching profession. The ,papQr continues, then, by out^3,ining clusters 
of capabilities that may be included In the common body of knowledge. 
These clusters of capabilities provide the Kasis for the following material 

The materials are oriented -toward assessment and development . First, 
the yari^ous components, rating scaled ^self-assessment,s , s6ts of objectives 
and rest>ective rationale and knowledge bases are designed to enable, 
teacher educators to assess current practice Relative to the knowledge, 
skills, and commitments outlined in the aforementioned paper. The assess- 
ment is conducted not necessarily to dete^ine' the worthiness of a program 
or practice, but rather to reexamine cu^-ent pra<:tice In order to articu- 
late essential coifimon elements of, teacher education.; In effect then-, the.' 

■ m ' ^ ■ ■ 

"challenge" paper and- the ensuing ma^prials incite f urther discussion- 
regarding^a-coifmion body of practic^^^or teachers. » 

/ ' M ■ ^ ' ■ 

SecJnd and closely aligned tfiTiassessment is the developmental per- > 
s'pective offered by these mater ifls . The ^ssessmei^: process allows the 
user to view current practice on a developmental continuum. Therefore, 
desired or more appropriate pr|ctice Is readily identifiable. On another, 
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r\ ■ ' . ' ^ 

perhaps more important di-n^ensioti, the "challenge" paper and theSe materiajpe; 

■ , , 

' fQcus discusa,ioii on presetvice teacher education. / In making decisions ' 
Regarding a >common body of practice it is essential that specific 
knowledge/ skill and commitment be acquired at the p^eservice level. It 
is plsp essential that other additional specific knowledg^e, skill, aijd * 
commitment be acquired as a teacher is inducted into the profession and 
matures with years of experience, - Differentiating among these levels of 
professional development is paramount. These materials can be used in , 
forums in which focused discussion will explicate better the necessar;^ 
elements of preservice teacher educal:ion, ^ This explication will, then 
allow more productive discourse on the necessary capabilities of beginn:^ng 
teachers and the necessary capal^ili ti^ss of experjL^nced teachers.* 

In brief, this work is an effort to capitalize oil the creative 
ferment of the teaching profession in striving toward excellence and 
professional developm^ent . The work Is to be ^viewecl as evolutionary and 
forma tivct. Contributions from our colleagues are heartily welcomed. ^ * 



• ) . . - *• 

FOj^MAL OBSERVATION OF STUDENTS' SOCIAL BEHAVIOR • v 

' This module 'reflects the author's experience that, while many clgssroom 
teacher? respond enthusiastically tp new, and often Jielpful, educational 
perspectives and procedures, systematic observation Veoords of social behavior ^ 
add botK to their ability to assess students* special^ needs and-to evaluate 
trhe .effects of specific programs. Often, however, teachers are prevented by 

y ■ ' ■ • r . 

time and setting constraints ftom using on *a regular basis the observation \ 

■J 

procedures they are taught in, some training progr^$ . many cases, instead 

j|)f learning principles for the flexible applicatioif of ob/ervation procedures, 
they have been given practice with specific observation! Procedures that are too 
complicated and time consumihg for regular classroom us/. This module is intended 
to- guide teacher trainers in exposing teachers to a samplinj^ of simple ohseTrvatlon 
and recording procedures so that they ,j^py learn„ to view ^st^matic observation . 
• as a tool to be used when neede(3 rather than a burden to be avoided unless required 
as- a course assignment. The procedures suggested In this module can be remembered 
and used, to good effect inl'the clgssroom with little preparation or practice. 
The discussion focuses on issues in the choice of the right procedure to meet 
a specific classroom need. Al^ho^^sonte of thes procedures* described could not 
be recommended for use in research, there will be substajiti^l gains in .professional 

' - " « 

practice if teachers learn to apply them. To. this end, content has been arranged 
to ■pfWid^e^ttie'teacher educator wlt^T"ifta^trerlals f or introducing -this import 
topic to pre- and in-gervice Jieachers through a lecture/^liscussion^^ro^ch . 

The resulting tteatment o^. observation" procedures will not satisfy the 
heeds of the researcher who 'wishes to usfe observation for a scientific study 
of human behavior. - Nor Will' it meet the needs of the psychologis^t or teacher 
educator who wishes to develop a solid understanding of the principles 
'underlying the application of ol^seirv^tiort methodology, to education. 'For these 



users, additional readings are suggested, and two representative papers have 
been in/luded as stn appendix, 

• - . , , ■ \ . 

^Other modules in the total set which are relateJt~ttr-this topic include: 

■ t . , 

Class Management . ^ ' • Module 3A 

Developing Goals and Objectives for lEPs ^ Module 9A " 



Contents . 

, ■ * ■ 

Within this module are the following components: 
Set of Object-iv^s - TVffe objectives focus on the teacher educator 

rather than as a student (preservice teacher). They identlify 

A 

jwhat can be expected as a result qf working through the 
materials .-*jrhe objective^ which apply to teachers are also 

identified. They are statements about skills, knowledge, 

•* 

and attitudes which should be part of the "common bod^ of 

* *" ^ , . ' 

practice" of all teachers. , ^ X 

Rating Scales - Scales are included by which a teacher' educatdr'^ 

. could, in a cursory way, assess the degree to which the" 

knowledge and^ practices identified in this module are 

prevalent in the existing teacher-training /program. The 

rating, scales aiso provide a catalyst for further ^thinking 

in each area. . i 

Self-Assessment - Specific test items were developed to determine 

*• 

a user's working knowledge of the major concepts and prin- 
- ciples in each subtoplc. The self-assessment^ may be used as- 

a pre-assessment to determine whether one would find it 

* * ■ 
worthwhile to go^ through the module or as a self cTheck, 

a"T t er tb e ma ter ia Is Tha ve been worlced "Through .* The^^s^l f — 

( 

assessnfent items also can serve -as examples of mastery test 
questions for students. A ^ » 



r 



Rationale and Knowledge Base - This section summarizes a number Pagj^ 8 

of me^^^^^for systematically observing and recording the 
social behavior of students on class management* The more 
salient concepts and strategies aYe i;eviewed. A 'few brief 
observation activities for students are outlined and attached 
at the-end of this section. 

Bibliography - A partial bibliography of useful books and materials Page 55 

♦ . 

is included after the list of references, 

' t. 

Articles - Two articles (reproduced with author's permission) Page 55 

accompany ^the aforementioned components. The articles 



support and ex^nd on the knowledge base, 
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Oblectlves for Teacher Educators . 
and for Incorporation into ' 
TeaGher Education Cur riculuiu \ 



^1. To distinguish between student behavibrvtha t can be /Orbserved dliSrectly and 

student problems which can only be inferred from directly observed bel^avior. 



2. To understand the role played by observations of behavior and . inferences 
•based on them In making decisions about^ students ' special ne€^,ds. 

^. To understand the practical implications of the fact that po beliaylor 

record is a complete record of all that^has occurred in a given setting. 

A. To know the differences between the following observation procedures; and 
their appropriate uses to record the behavioh: of individual i^tudents or 
groups: ^ • ' ' . ^ 

a- anecdotal records of critical incidents. 

b. * narrative records. 

c. behavior logs. 

d. ^ehavlor rating scales or checklist's. 

e. jBehavlor objectives 'sequences. . ^ 
f -.^observation schedules. ^ 

g. event frequency counts. ^ ^ 

\i. summary charts and graphs. j . 

5. To- understand how to keep simple records of interactions^mong Individuals 
in a group • ' ^ ^ 

6. To understand how to record the collective behavior of an entire group of 
individuals. 




7. to und^Y'stand the practical •implication of the concepts of reliability and 
validity as applied to observation records^ 

8. To apply several observation recording procedures in actual or videotaped 
situations. ' * 
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Rating Scale for Teacher Pi\eparatlon Programs 

i ■ 

Students being prepared for teaching do not use observation as a source 
of information about pupils* behavior, placing inajor reliance on stan- 
dardized testing procedures. Observation recording is sporadic and of 
the anecdotal or critical incidence variety^ Stress is on enervation ' 
of students who attract attention by their "acting-out" behavior . 

Students practice writing narrative records or summary reports as part: 
of the assessment and evaluation of pupil behavior. Observation limited 
to unsystematic approadieg. Stress is on observation of students who 
attract attention by their "acting out" behavior. 

' /■ • 
Students use behavior checklists In addition to narrative records as a 
means of recording observations of student behavior. Sttess still on 

observation of students who attract attention by the "acting-out" behavior. 

'■ * ' ■ ^ ' ' ■ ^ 

Students know how to do event frequency recording as a me^ns of measuring 
changes over time and use this in addition to narrative records and check- 
lists. The focus still tends to be on the observation of students who 
attract^ attention by "acting-out" behavior. ' 

Students learn a* variety of observation/recording procedures together with 
their uses. Procedures are used routinely for assessment, monitoring and 
evaluation of pupil behavior and chahges in behavior over time. Observations 
are made of all students and individiial records are interpreted in the context 
of the behavior of others in the group, including that of the teacher. 
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g el f -As ser> smen t 

' ^ . - • ■ • 

People act J.n 'all of the ways listed below. Put an *'0" In the space in 

front of those that can be observed directly and a "X" in front of those 

that must be inferred from other actions that can be directly observed: 
y - ' . • 

Studenti hits another student 

Student sits down' in a* chair. ^ - * 

Student feels angry. ^ ^ 

Student expresses affection for he-r teacher. 
Student writes on a piece of paper. 

Student throws a. paper girplane. " 
Student- puts his hand on the teacher ^s shoulder: 
Student hate^ the principal > > 

Inferences about the feelings that jaccompany behavipr should be recorded: 

a. never. * *^ 

b. only when they are clearly expressed. 

c. onlV when the behavior on which they are based is also recorded. 

d. both b . and'iC. ■ 

- )S ■ • 

List at least th^ree' ways to make observation recording easier for the 
observer. ^ 




b. . ' 

c . ^ 

Incomplete observation records are necessarily less__ , 

than more complete observation records • ^ 

•a. 'reliable. 

b. valid. ? . 

c . .both a. and c . , ^ 

How does an "anecdotal record" of a student's behavior during one 15 minute 
session differ from a "narrative record" of that same behavior. 

a. it is less objective. 

b. it is less complete. 

c. it is written down after the behavior occurs. 

d. it is more easily recorded by an observer. 

You wish to obtain a parent's view of his sort's behavior during the coming 
v^eek. What method of observation recording would you use? Why? 
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7, Below are examples of interval and frequency recording of a student's* 

talkiji^ <?iit- with during a five -minute-observation -period. 

Label each. 
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Which is the more complete record of talking out without permission? 
Which would be eas^ier for a teacher to keep while he/she is teaching? 



8. The following are items chosen from a problem behavior checklist. Mark the 
'space in front of those which require the rater to make inferences about a 
student's behavior in responding. 



a . doesn ' t speak 



J b. speech unintelligible 

c. destructive of property 



d, takes things belonging to 
others without asking them 

e . irresponsible 



f- plays with younger children 



9- Two observers observed the same students at work for five minutes. At the 
endrof each minute, they mark on their record if the student has been 
attending to his/her work. Here are their records: ^ 



* 


1 


2 


3 


4 


5 


A. 














1 




3 
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B. 


^ 1 











What can you say about the reliability of their observation records? 



9. (continued) " 

■ ■ \ 

What can you say about the validity of their observation records? 



* 

'I 

10. Here are two descriptive statements about a student. 

a. Student hits his classmates frequently. 

b. Student expresses deep-seated feelings of anger frequently. 

For which of these two statements will it be easier to obtain a reliable 
observation record? 



Dl. How are a behavior rating scaTe and a behavioral objectives sequence alike? 
How are they different? , ^ 



12. Behavior ratirvgs are often compared to average ratings furnished by the 

developer of the rating gcale. What other comparisons would it be important 
to make in evaluating the '^normality" of observed behavior? How would you 
obtain the needed information? 



A teacher has^. kept data on the total number of questions asked by her students 
after she introdu^ces the daily math le^sona. Becati^e hex original ,CQunt showed 
too many queo^tions were being asked, she ihtroducedl^n intervention to bring the 
number of questions dowp. \Peeling that mapy students were simply finding it 
. easier to ask .questions thatpread the directions^, she Informed the class that 
all questions were to be written on a piece of paper ^o as not to disturb those 
who were already beginning to work. Here is her observation record for a three 
week period. Was this* a good choifce of the behavior to observe? To seek to 
decrease? What does the record show? What questions would you h^ve asked the 
teacher? What other information migh*: you want to collect? * / • 
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• . , jl 

14. Htere is a sample narrative record. Encircle the parts of '^he record that 
require.d inference by the observer. 

Chuck I3 seated'^ his desk, smiling. The teacher, in starting a 
discussion about the character of Hester Prynne In Hawthorne ' s. "Scarlet Letter," ^ 
agks members of the class to volunteer their ideas* Chuck responds' with a 
' loud laugh and the reijiark, "She's a whore." This draws laughter from some less 
mature members of the class- As u6ual, he is^ seeking ways to disrupt the dis~ 
cussionv The' teacher continues with the question, "Can we analyze her motix^ation?" 
Jeff offers to answer. The teacher says, "Yes, Jeff-" At this point, most students 
are' looking at Jeff as he begins his answer, "I read it several times, and 
r^huck tries again to attract attention by blurting out,- "l only read it once," Most 
^ of the class would definitely like to hear what Jeff has to say without having \^ 
th<^se interruptions, but ther6 i^ some laughter again- "^eff continues, "I think 
she is basically introverted/' Chuck says loudly, "introverted, she's not introvert- 
ed. She's perverted." Many students laugl> in embarrassment at his crude remark. 

The teacher tries to make Chuck be serious by saying to him, "Let's go beyond that " 

Chuck shakes his head;' pretending to be embarrassed. "You said she was perverted," 
says the teacher, "Now, back it up from the book." Chuck replies, "you know what 
they were doing out there in the woods, her and her imp kid. I could Just read 
between the lines. My mother wouldn't want me to know about those things." Of 
course, this really just illustrates what a dirty mind Chuck has. 

Note: Adapted from material from the CONSERT Project, by P. Pattavina and E. A. Gotts, 
School of Human Development, University of Texas at Dallas. 1979. 



15. "Most teachers who observe and record systematically accept the behavlorlst 
view of Instruction and learning. Records of that klad are not very impor- 
^ tant to those of us who place Importance on tJie|^5^l^elo!pment of good feelings 
about self and others in our classrooms." Commenfei on this statement. 
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Formal Observation of Students V Social Behavior 



Special educators who are oresponsible for direct service to students , 
•with educational, disabilities havje found systematic methods of observing ' 
and recording relevant student behavior to be a vali\aj^le tool for aiding 
their students' learning. Applicatioft of these ncathods reqjaires additional 
teacher time, which suggests tjhat those teachers wn^ use them must be 
repaid by an increased sense of professional contf<etence and personal 
satisfaction, The teacher willing to commit this additional time, which 
is greater during the initial learning period, will find that observation 
methods are easily mastered and the rewards are real. Observatiortylata alone 
are not an adequate basis for analysis of a "behavior problem," which often 
has its origin in complex interactions amqng people and environments (see 
Cantrell & Cantrell, 1975; Smith & Grimes/ 1979; Prieto & Rutherford, 1977), 
but it is a critical component of the total assessment. 

The purpose of this paper is to introduce several methods of system- 
atic observation and to comment on their relative advantages and disad- 
vantages in order to assist the beginning observer to make a thoughtful 
choice of the procedure that ^est meets his/her needs. Examples are provided. 
Fuller discussions of the various theoretical perspective? on obser^^ation 
are avalAble in Weinberg and Wood (1976). Boehm and Weinberg^ (1977) have 
written a brief, nontechnical manual that expands On several of the tppics 
mentioned here; they also discuss such issues a? reliability and validity which 
relate to observation as measurement. For a discussion of applications of 
observation to research, see Hersen and Barlow's .(1976) excellent book. 
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SoTTRe Key Ideas 



I 



\ 



Before proceeding jto the (discussion of methods of observation, several key 

terms which will be used throughout this paper need explanation. A good grasp of 

• \ «■ 

their meaning will' help the reader better understand ' the distf|)^sion. TJJese terms 

are o'bservation, observation records description arid inference, valuing, and 

labeling. The reader will note that they have to do 'not only with the act of 

observing, but with what one does with those observations. • » . . • 

Obs ervation is of -course the key term. What is good observation? How • 

does observation differ "from looking? ^ All humans spend much of their waking hours ■ 

, ■ . ■■ ■ ■■• . . ^ . ■ ' . • 

looking at thin^ in the vorld around t;hem; all people are, in pome sense, observers. 

< * ' ■ ' . .■ ■ . ■ ' . 

The difference bietween "lookers" and, "observers" is sys,tem. Good observers have 
trained themselves to watch carefully f.or easily overlooked patterns of activity. 
Good observers are careful, systematic "lookers." 

One can never r^lhiber everything that he/she has observed. People quickly 

j» • . ■ 

forget the details of what they shave seen and find that memories alone are often 
unreliable. Therefore, people who need to use observation for teaching purposejs 
find it helpful to make observation records. Later in this module, several different . 
kinds of observation records will be described. It is important to note early on, , ' 
however, that the method chosen for r^fcording observations a\so influences what - 
is observed: By choosing a method ^f recording that will be sure to provide th^ 
information needed to help in .decision-making, one can be more certain that the 
observations are directed toward what is important in the situation observed >^ 
rather than being haphazard. 

A good observation record is a careful, accurate description of some of the iv 
actions of persons in the situation observed. It is a description of what the/ do, 
their directly observable orv, "overt" actions. Their thought and feelings are of :^ 
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Interest te the observer as well» but thoughts and feelings -caniiot be observed 
directly. Because thoughts and feelinjgs air'e "covert," what is said about them 
results from inferences , which are bfesed on observation^ of actual behavior, 
but which must not be confused with the obser.vable behavior itself. In every- 
day activities, -one is continually observing, inferring, acting, observing effects 
predicting outcorties . It is often difficult to separate actual observations from 
the cognitive operations that are performed usingUhem. Vhen one uses information 
obtained through observation for educational decision-making, however, it is im- 
portant that sincere effort be made to separate observations f^ra what is done 
with them, especially In regard to the drawing of inferences . If one cannot 
separate them-, he should at least learn to recognize when he is describing, when 

he is inferrinR. and when he is combining both processes. ; 

•* ^ . ">• ■ b. . ■ 

People never observe without placing a value judgment on what Is obser,ve(I, 
or valuing it in a negative or positive sense. Students are observed ift^schopl 
settings because someone considers their behavior of concern. Valuing enters 
into observations of students with scho.ol-related problems very frequently. But 
here again, one needs to try to keep. the valuing of the observations separate 
from the descriptive notes in thp observation records themselves^ One needs to 

% ■ . . 

learn to describe' behavior first. Stating that it is "good" or "bad", should ^ 
Gom^ later. Unfortunately, this is not the typical case.^ Usually, one begins 
With a negative evaluation of a stxident's behavior based on haphazard observation. 
Thus, someone reports that John fights w,ith other student^. Since fighting with 
other students is generally considered "bad," the observer sets out to observe 
carefully how often John^^hts and, t6 keep a record of the number of >U.mls. 
Thus, the value judgment has shaped the choice of what kind of record to keep, 
and that in turn will direct the observations , ; 
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' Valuing of observed beVavior lei^^ to' the application of "labels . " . v 

Labels can be useful syihbolic shor thand» Lal^^^^s' 3^*^ dangerous, however, wheo« 

■ ■ - . 

they are used carelessly , ^ forgetting how much observable behavioral detail is subr 

*^ * ■ ■ ' 

sumed under a^ single word like "emotionally disturbed" or^ "behaviorally *^disordered 
Labels such as these have a poweVf ul jiTDpact on the educatldn^^l Experience of the 
Students to whom ^they are applied, and are often used^ carelessly . One must be on 
guard about this, because when someone J.s given a label such as "emotionally 
disturbed," it is too easy to think one knows what he/she\is like. "Oh yes, 
emotionally dlstu/l>ed. What a problemf"< The more detailed and specif ic observa- 



The 
)re will 



tional record^ of students are, the more will be known about-*their actual behavior 
and. the less will be the need to rely on these broad labels. t 



ANECDOTAL RECORD OR CRITICAL INCIDENT TECHNIQUE 

Most eduo^tors have' recorded observations of "critical incidents" in their 
classroom in a narrative, anecdotal record format. A discussion of this pro- 
cedure will introduce several important principles of good observation tec^- 
nique. Using the anectodal record proce^iure teachers describe in narrative form 
Incidents of a student's behavior whi considered especially noteworthy. 

Most such records are of disapproved behavior; the narrative illustrates the 
student's particular problem. In the following narrative, the behavior of a 
student referred by his teacher as disjractible and hyperactive is described:- 

During today's math seat work time at 10: 30* a.m., Bill was; 
restless and distractible as usual. He kept turning around 
in his seat and bothering his neighbors* ,1 had to speak to 
^ him several times, but he always started up again in^a few 

minutes. Eventually, he began talking to some other children. 
When Mary refused to pay attention to him, he poked her with 
his pencil. By now his behavior had become so oiit of control 
I had to ask h4.m to leave the room and sit on the bench outside 
Mr. Brown's office. This same sort of thing goes on every day. 
He juijjt won't slt^still or pay attentiotil 



Jis the teac|(fer*s indictment of a student whose behavior is a problem for her 

and some 6f his classmates, this stateinent is useful?- As a systematic 

description of his behavior, it is po^r. As an assessment providing a basis 

for planning vays toy ameliorate t]\c situation, it is of little use. 

The account begins well with the record of the time of day and the 

activity. However, because like most critical incidents this one was written 

at some later time, the time of day is only approximate! The' events described 

are-not related to specific times of the period, 

' PRINClPft: 1: Observation data should be recorded at the ' 
time they ai^g observed. 

PRINCIPLE^ 2: Observation da ta should 'be continuously rela ted 
^^'^^^ ^^^^^ thq^ observed events pccur. 

If one is to obtain/ an unbiased description of a student * s^behavior , 

then it must be planned in advance when tlie student will be observed, an(J. 

observation^ must be recorded continuously during that period, linking them to 

the passage of time. If one notes^down only the times when the student's 

problem behavior is at its peak; the record will tend to be biased toward 

merely documenting of the observer's pre-existing negative e/aluation of the 

student's behavior. 

The preceding sample record fails to separate inference from observed 

behavior — a very common problem. Inferences are often value laden. For 

example, Bili is described^ as "restless and dj^stractible as usual" and "out 

'^f control." Despite the strong tendency to agree immediately with suCh 

descriptions, one must tak^ a closer look at theiri. On what behavior are these 

statements based? Instead of a description of how Bill behavies one has the 

teacher's evaluations of that behavior. Furthermore, there Is no ba'sis for com-- 

paring BillVs behavioi: with that of his peers. Are they also "restless and 

distractible"? How much more "restless and distractible" is Bill than they are? 

The Issue of normative behavioral observation is also discussed in the attached 

■ I. ■ ' ■ / 

teadlngs, / 
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PRINCIPLE 3: An observation record should be based on 

* observable behavior*. Inferences about " 

th^ghts and feelings , which are- not 
directly observable, and evaluative 

comments should be linked to a des- 

\^ ' ■ , ■ 

crlption of the behavior on which . 
they are based. 

PRINCIPLE 4: Quantitative statements about whether 
p an individual stuc(ent behaves in a * 

particular pattern more or less than 
peeirs should be referenced to observ- 
ations of peer behavior^ made^ at the 

same time and place. / v - 

Would everyone have agreed with Bill's teacher that he is restless and 

distractible? The question^ is h^rd to answer. What ^does the teacher mean 

by "restles.s and distractible'"? Would not it help if there were some 

agreement in advance on what those terms meant? . 

PRINCIPLE 5: Descriptions of behavior should be phrased in ' 
terms that are well defined. These definitions 
should be communicated along with the description ' 
of the behavior • 

.Principle 6: whenever possible, more than one observer should 

, describe the same behavior. If this, is not feasible, 
• . ' observers should practice together or test themselves 
against an expert standard to avoid the Inadvertent 
intrusion of idiosyncratic bias into their observation 
records. . . ^ 

NARRATIVE RECO RDS AND LOGS 

— — — ' • - ^- ■ ■ / 

Principles 4, 5, and 6 are not easily accomplished when the anecdotal 
record technique is used. But, this procedure for recording observations 

can be a more, useful source of information than the firs t example if Principles 

<••■■■ ^ 

•1, V f nd 3 are applied. Such a record will be called a narrative record -to 
-'differentiate it from the post hoc anecdotal record. Be'low, the reader can see 
liow the sample incident might read if the recording were made as the inj^^ident 
unfolded, the time intervals were noted more frequently, and evaluative termino 



logy were avoided. 



10:30 a^m.: Class doing math seatwork. 

10:33: Noted Bill looking up froTi) work, drwTnming with 

pencil on desk. • 

10:35: Bill turns 90% from front and leans toward Mary's 

* ^ ,desk. He turns back and looks down at work, when . 

I look at him and /rown. . 

10:38: • (Had been busy helping George at front of room 

for several minutes.) Bill has turned toward ^ 
Mary again and is saying somethingr* I cannot 
hear to her while he looks at her paper. 
Mary tries to turn her back on him and moves 
her paper over to th^ other side her desk- 
Bill pokes her back with his pencil. Mary , 
o slaps back at Bill who yells out that she is , 

a % , and he doesn^t want to s«fe her ^ . ' 

paper anyhow. He is standing up now, and as ' • 
I move toward him, he backs down the aisle, 

kicking at desks and chairs as he goes. I . ^ 

point toward the door and he opens it and 
backs away down the hall toward Mr. Brown's 
office. I tell him to sit on the bench and 
go in to,.^]splain to Mr. Brown why he is there. >^ 
When I coTft^:'out again Bill is sitting on the 
bench but Vill not look at me or speak to mfe. 
I tell him he is to stay there until I come ^ 
: * " to get him. Bill turns away and says some- 
thing I cannot Kear. 

10:43: . Back in class. There is qpme noise^ and talking 

going on as I come into the room but the students " 

turn back to their work when I come in. 

' ■ ■ , : ■ ^-S: 

This time, the teacher has given an account of direct observatipns 
of Bill's behavior rather than a statement primarily describing reactions 

c 

to that behavior. It is possibloNfor teachers to write such a record if they 

are trained (or trqin themselves) to observe, make. brief notes at the time, 

and write out a complete description of the incident as soon as possible ^ 

Used by well-trained, experienced observers, who often employ special techniques 

to facilitate the recording of as much detail as possible, the narrative 

record rivals the videotape in Its approach to the unattainable goal of a complete 

record of behavior and has the advantage of flexibility of use in field situations 
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where accurate ,30und recording, is often impossible- It is difficult to vrite 
narrative record^ without resorting occasionally to the use of inference/, 
however, as' this segment from a narrative record^ written by a skilled observer 
lllu^stratea: 

(The subject i^^atrick Taylor, a f Our th-grader , who walked on 
.crutch|es With his right foot carried in a sling, due to Perthes 
• disease.) 

Titiie: 10:22 a .m. - ' 

^ Noticing this, Patrick jumps up, since he /s the next one to bat, 

and swings on his- crutches over toward the backstop, 

"^s he approaches. Glen walks- toward him and says in a friendly , 
cheer Yul way, "1*11 run fpr you." , ^ , 

At the same time, Harry calls over> from the bank, "Hey, Patrick, can 
I run for you?" . 

Patrick turns around and, without responding directly to either of 
these two boys, picks up a bat from the ground. 

He looks at Ken, who's standing nearby, and speaks to him in a 
- ' quiet voice. I c§in't hear what he says.' ^ . 

He obviously asked K^n if he!d run for him , however, for Ken runs 
immediately over and takes his running stance just a few feet away 
from hoirte base on the first base line. 

/'^^ . * ' • ' 

Patrick hops with the bat directly up to the plate, leaving his 
crutches by the backstop. 

« 

He stands there, balancing deftly on his left foot, with the bat 
perched eagerly up on his shoulder, rq^ady to bat. 

Just before he reaches the plate, the pitcher calls In to hitn wi th 
sligh t impatience at the delay , ^'All right, let's go Patrickl" 

The first pitch comes across, and Patrick swings. The bat connects, 
but it's a high foul ball which the catcher cannot get his hands on. 

Pa tr^ick watches the ball's trajectory, then hops around, swinging the 
bat for practi ce as he waits for the pitch. 

Thfe ball goes back out, comes in again, and again Patrick connects. 

This hit goes down toward the. first baee but outside the line for 

another f ^ul. i 

The runner, not being 5ure » goes aprt way down toward first base to 
play safe. 

Note: From "An Ecblogi^cal Study ^df Children with Physical Disabilities in Scfiool 

and Home" by P. Schoggen. In R. Weinberg & F. Wood (Eds.), Ob^^ZSLtt^^ 

and teachers in mainstream and, special education settings. Reston, VA: Council 



^ for Exceptional Children^ 1975; • 
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For more ideas about narrative recording see Schoggen (1964) and the material in 

the "Activity 1" intended to provide students with experience in doing narrative 

■t ■ * ■ 

descriptions of the behavior' of an observed student. 

Narrative recording, particularly of the ^^^cdotal type, is the method 

of observation recording used most frequently by teacl^rs, probably because it 

seems a "natural" way to record, one that requires little special training 

or practice. Teachers often keep run\iing anecdotal records on students about 

whofe behavior they are concerned or narrative logs. Actually, as the example 

4 

illustrates, the best narrative recording requires training and skill and is 

i ■ ■ . 

a full-time task for the observer • There are other methods of recording that 
are more. easily used .by teachers, and while none of them meet all of the 
principles of good observation practice lis,ted above, the records obtained will 
be of better quality than the typical informal anecdotal record. 
BEHAVI OR, T IME INTERVAL, AND FREQUENCY 

To make observation recording easier, one must sacrifice some complete- 

■ 

ness in the record and accept the necessity of making inferential judgments 
as one observes. Consideration of certain key variables will assist the 
observer in making good decisions about the choice of ati observation method. Th 
key variables needing consideration in planning an observation systein are the 
behavior patterns to be observed, the time interval in which tl\ey are to be 
observed, and the frequency of their occurrence. When observing some behavior 
patterns, it may also be important to observe their duration, that is to say, 
how long a 'given occurrence lasts, but the specif ication of which, when, and 
how often will cM^er most cases with which teachers are concerned. 



\^ Before turning to a mo^ detailed study- pf some examples of procedures 
developed for observing and recording behavior , the reader is referred to 
Figure 1 which summarizes the options, showing how one can vary the difficulty 
of the observer's task and*" the ease of recording along the dimensions of 



inclusiveness and detail of description. 



Complete description • Partial description 

More Short; time intervals Long time Intervals Less Difficult 

difficult (continuous) (time sampling) to observe/ 



A' 



to observe/ ^ . . ' record 

record Many behavior categories .Few behavior cate- 

(exhaustive) gories (focused) 

Frequent occurrences . Rare occurrences 

Figure 1. Dimensions of inclusiveness and detail of description in the 
observation and recording- of behaviors. 

In the following discussion, the author reviews some procedures that vary^long 
these dimensions, beginning with . those less difficult for the teacher/gbserver ' 
to use-and proceeding tp some of grea ter difficulty which ha v^leatures that may. 
recommend them for special uses. Each will have its advantages and disadvantages 
over anecdotal and narrative records- , 
A Very Simple Record 

One may begin with a very simple system. Since writing out a narrative ^ 
description of behavior takes all tjje observer's time, i.e., the observer attempts 
to record as much as he/she can without limiting in any way the kinds or frequency* 
of behavior to be recorded, orte may "decide in advance that all social behavior 
observed will be classified simply as either "acting-out" or "withdrawing." Most 
problem behaviors seem to. cluster under the one or the' other of these two catego'^es 
They are rather general terms, atld to apply tftem one must use some inference, but 
they can be pinned down by stated, specific 'examples. For example, "acting-out" 
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Includes such behavior as hitting people or objects, yelling, making loud noises, 
and the like, whereas "withdrawing" includes turning away from others, not speak- 

* • * . . . 

ing when spoken to, and the like. If the observer decides that he/she will check 
a child only once a day for either kind of behavior, the time interval is one day. 
Thus, the observation record might consist of a sheet divided into two columns, 
one. headed "acting-out behavior" and the other^ "withdrawing behavior," in which 
is entered a tally mark each day on which the student's behavior is observed. 
The* total of Jth^ the frequency of occurrence of the behavior. 
Going back to the narrative description example again 3, it looks as , if one would 



l||||||e placed a tally mark in each column to record observations of Bill^ behavior 
on'\^hat particular day. He acted out at sometimes, but he withdrew at others* 



This system is limited, of course, by its very simplicity, but it has some 



advantages over the use of anecdotal records and is legs time consuming than a 
narrative recording procedure. For example, the behavior of selected peers can 
be easily observed and recorded on the same basis so as to provide a context for 
considering the relative uniqueness of Bill's behavior. Also, one can check his/ 
her observations against those of other observers, thereby obtaining an estimate 
of inter rater reliability /-W ^ 

1 ■ ■ ^ ' - ^ . ' . 

The same advantages are retained when one begins to refine the system by 

/ ■ » • ' ' 

breaking flown general behaviors into more specific behaviors and/or longer 

' ■ . ■ / 

time intervals into shorter ones. Since the number of behaviors x the number of 

■ • *Y 
intervals = total possible frequency qf recording each day, the i>osslble frequency 

* ■ ■ ' 

totals rapidly increase?' In the example above, *he total, possibl^e was only two. 

But, suppose a teacher decides to record the occurrence or nonoccurrence of three 

behaviors each morning and again each afternoon, or twice a day. The total number 

of tallies poesible now increases to six, a small Increase to be sur^, but the 

■ ■ • , ... 

. ' trend is clear. Evei) simple yes /nq decisions about the occurrence/nonocci>r?:ence 

Q 4^ an^event take thitliHlng aw^ y^^^^ yes/no ^decislojis on ^ 
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the occurrence of a particular behavior can a teacher manage each day? 12? 

e 

100? 500? At what point is the increasing number *of tallies no longer a 

........ . . ,» .... 

useful addition to the recorcl and just nior^ work? - 

Therq ift no definitive answer to this question. Egcli problem one seeks 
to solve requires the reconsideration of the trade-off beti^e'^n number of kinds 
of behavior to be recorded and length of the observat^lon interval. ^ The specifii 
of the system should reflect the purpose for assessing each individual^ student . 
As a practical mattex^, xis^f ur..x>haar.v^tio^ possible 

tallies per day f Qr a^&lveQ individuA. Reviewed below_ar_e sev.erailsp-,e.c±f ic 

observation systems' that will serve as examples of the further application of 
the ideas iust discussed. 

Behavior check lists * • * ' 

Behavior checklists or rating scales typically list 50-60 coiftmonly 
observed behavior patterns. Usually completed on a time interval vary- 
ing from a Veek to a year, the observer checks those behavior patterns 
that characterize the person observed. Most scales provide for a general 
estimate of frequency of occurrence by providing space to indicate whether 
the checked behavior occurs "never," "seldom," or "often." One might say 
that in such a scale the two broad categories of behavior, "acting ou<" 
and "withdrawal," have been broken down into many separate behavior pat- 
terns, thus making more work for the observer but providing a more com-' - 
plete record. Examples of well-known, commercially available rating scales 
are the Quay-Peterson Behavior Problem Checklist (1979), the Walker Prob- < 
lem Behavior Identification Checklist (1976), and the Devereaux Elementary • 
School ^ehaviqr Scale (Spivack, & Swift, 1967), 

Ift completing a rating scale, an observer typically makes numerous 
retrospective Inferential judgments about the relative -severity and dtirat ion of 
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the t)ehavior observed. Below are some sample it^msf from the School Behavior 
Profile, a representative checklist developed by Balow and Rubin (1974) as 
part of a longitudinal study of the social and academic behavior of students. 

Nervousness, jltterlness, .jumpiness . , (inference required:) 

Hyperactivity, hardly ever still. (inference required.) 

'Doesn't speak; uses only grunts or npises to communicate. (descriptive. 

Inference required only in estimate of "frequency.) 

« ■ 

Anxiety, general fearfulness. (inference required.) 

Steals. (descriptive^^ inference reqiilrea only for estimate of frequency. ) * 

Disruptlveness; tendency to annoY and bother others . (inference 

required . ) > 

The lack of a full definition of the descriptors used and the absence 

♦ 

of provision for recording ^ description of the specific observed behavior 
on which the rating is based tends to decrease the usefulness of such check- ^ 
lists as observational records. Checklists are also lacking in focus on specific • 
behaviors of concern in the individual case. Observation checklists and scales 
are probably most useful for collecting general impressictns of behavior from 
parents or teachers who have not been trained to provide more detailed descript;ions 
of behavior. Such ratings should not serve as the basis for decision^making about 
Students. However, they can be made more useful if the list of items to be checked 

is more carefully tailored to fit the needs of a particular group of students or 

. J ■ . 

a particular program. Such a list tnay also be shortened or simplified by dropping * 
descriptors not relevant to the problem behavior of any particular student pr 
group of students with whom one is concerned. Responses to items that require 
considerable inference should be viewed^ cautiously. '^Depression," -^anger," and 
"anxiety*' are examples of internal statiifes that can be revealed through many 
different overt behaviors and masked by many others. 
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Simplif ied Event Recordln g^ 

Behavior checklists and rating scales make observation recording easier .•; 

by setting a limit on the number of behavior patterns to be described, making .; .'| 
it easier to record frequency of occurrence/nonoccurrence, and using a long 

time Interval. As suggested, as the number of behaviors to be checked is reduced, *. 

the task of recording becpmes easier, /vj 

There are othpr ways to simplify the observer's task and save time for ^ 

■ . ■ '" 

recording other information about the behavior observed^ ' l)^ -ha s"T)^ 

"Uie^a^Yual f Feque^^ behavior is usually t^J^ 

much lower than the incidence of approved behavior. Since the necessity for making .--^ 
a tally mark adds appreciably to the time required to make a yes/no decision, 

some observers record only^the frequency of occurrence of disapproved behavior. | 

For' example, since students ^spend more time working ("on task") than not working j 

("off task"), ^tallies are made for instances of "off task" behavior; since more ; 

time is spent "not hitting" than "hiiting", a record is made of the instances of-*- | 
hitting. One problem with such aVyHtem is that it focuses the observer's 
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attention on th-e student as a producer of disapproved behavior and may eclipse ^ 
awarenes's of -his more typical "good" behavior, but as one soon learns about .| 
classroom observation, "to get one gives". 'No system is without faults which r | 

' ■■ • . " . 

must be taken into account by the thoughtful observer. .. 

By eliminating behavior des<5riptors according to one or more of these rationales, |j 
experienced observers hav^ developed useful general systems that require the re- 
cording of the frequency of only a small .number of kinds of behavior. Forced by 
circumstances to choose only one behavior to be observed, and defining it nega- 
tlvely to minimize the number of tallies to be recorded, a good choice would be 
the critical school social behavior of being "off task," that is, not attending to 
.one's work. "Off task" is defin^ as not looking at the assigne^d task, but - 




obviously subsumes many social behaviors that are inappropriate when 
work is to be done. Deno and Mirkin (1977) sugge3t four critical social 
behaviors to observe: "off task/' "noise/' "out of place/V and "physical 
contact." This simplified event recording system Will be described in more 
detail later in this module. 

Simplifying by Varying the Time In terval for R e cording 

Besides varying the number of behaviors observed to change the 
difficulty of the observer ' s task, the' length of time intervals for 
recording can be adjusteff~eo Fit the/observer's d^ailable time. As 
already noted, behavior checklists are commonly used to summarize observations 
'made over long Intervals; but they can also be used to cover Intervals of any 
length. In practice, however, one finds that as the intervals become as short - 
as only a few seconds, a point is reached at which only one behavior pattern can 
occur within an interval. By using intervals of 2-3 seconds, then, one gets^^an 
almost complete continuous record of the frequency or rate of occuriTence of an 
observed behavior. Only highly skilled observers can maintain sach a record on 
more than a few behavior patterns.' Usually, however, the possibility oi^ such a 
complete record is given. up in order to make the task easier, and the observer 
simply accepts the resulting loss of some information. How critical this loss 
■may be can only be answered in regard to a specific problem. . 

Intervals of any length can be used. If data collection will continue for 
weeks or months, entering one tally for an interval of as long as an entire 
daily class period is adequate for a record of some behavior patterns such as 
attendance at school or coming to class prepared. As a general rule, intervals 
of from 20 seconds to 1 minute permit observers to record accurately t^he 
occurrence of several key behaviors and meet most needs adequately* 

As menti9ned previously, a behavior checklist may be regarded as an 
extensive list of behavior patterns which Is completed by an observer as a 
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summary record at the 6nd of a relatiijely long period of observation. However, 
such checklists could be completed more frequently, daily or hourly, but since ^ 
they are extensive and include many patterns that are not relevant in aT\ 
individual case, such frequent completion wo«uld be awkward and time consuming®. 
Other than paring the list down to a handful of behavior patterns to fit each 

■ ■ V 

individual, is there some way to make it more manageable? The following strategy 
Yias been used successfully: 

(a) Develop a list of social and academic behavior patterns that are con- 
sidered important Within a school setting and/or to^ the development of a particular 
student or group of students; (b) Arrange the items in an order based on a typical 
sequence of human development or a logical task hierarchy (in either case the list 
will move from basic or pimple behavior patterns to more complex patterns that 
incorporate additional elements); (c) Start at the beginning of the list an^ 
check off the behavior patterns observed performed by the students being rated, 
eventually reaching a point on the lis t where' the listed behaviors are not being 
demonstrated by a particular student; (d) Choose the first five or six missing 
behavior pattern^as objectives for instruction and maintain a daily, individualize 
summary record of student performance, only periodically reevaluating students 
against the entire list. , 

This procedure has the work-reducing advantages of a relatively long time 
interval (school day or class-period) and relatively few behavior categories to 
be attended to at any one time while it retains the potential of an exhaustive 
description of desirable behavior shown by the student observed. Just such a 
procedure was used by M. M. Wood. and her coli|eagues at the Rutland Center, Athens, 
Georgia, to develop the Developmental Therapy Objective Rating Form (DTORF) 
for seriously handicapped students (1975, 1979) # 
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1^ In using such a procedure, teachers atid their^ assistants move down a list 

of behavioral objectives during the initial assessment, checking those behavior -» 
patterns they have observed performed appropriately by the student 90% o? the 
time. Instruction is then directed toward student mastery of a target group of 
six behavior patterns in each category- Each afternoon, after the students have 
gone home, the teacher/dssistant team distusses the students V behavior and makes 
a daily record of whether o specific behavioral obj ective was performed "always," 
"sometimes," or "never" by a given student. When mastery is shown for a sufficient 
period of time, the mastered behavior is "checked off the student's list an(^ attention 
turns to the next missing behavior pattern- Thus^ 'teachers observe and record the 
occurrence/nonoccurrence of approximately 30 behavior patterns for each student 
during each on^-day interval- Summary observation information recorded using 
this procedure provides ^n important data base for the program, both guiding 
instruction and permitting evaluation of program effectiveness. ^ 

Similar procedures using lists of behavioral descriptions/objectives 
have been described by Hewett and Taylor (1980) and. Stephens (1975). Sucli^ lists 



i are often used with intervals longer than a single day; however, the procedure 

i ■ ^ ' ■ 

\ described seems best suited to providing an observation record immediately useful 

i - I 

1 to teachers of students with special needs- In developing such a list of behavioral 



objectives f or- mainstreamed students, regular class teacher's should feel free 

to consult special education personnel. In most instances the best^time and place 

for developing such a list is at the lEP cbnference where regular and special 

I eduction teachers, school psychological staff, administration, and a student's 

i ■ " ■ ■ ^x 

t 

\ parents meet to formulate goals and objectives for the student and a plan to 

i * . • ■ 

I realize these goals aftd objectives. • - 



OBSERVATION SCHEDufi^: DENO AND MIRKIN'S FOUR BEHAVIORS x 

As already mentipned, Beno and Mlrkin (1977) %^lustrated another approach 
to developing a procedure that provides usefyl information to the teacher with- 
out requiring excessive time. Based on their experiences as consultants to 

class tea^^he^ working with special education students* they selected 

a group of only four social behavijor patterns that "fairly represent the 

i iti. 

» 

'categories of concern* for most classroom teachers" (p- 101). As already 
mentioned, Deno and Mirkin defined the fpur patterns negatively to make the 
rec^^dirig of frequency of occurrence less difficult: "noise," "out of place," 
"physical contact," and "off task." They suggested that the target student he 
observed initially 10-30 minutes each day for 5-7 days and, thereafter, as fre- 
quently as possible. T^e four categories are defined below (From Deno & 

Mirkin, 1977, pp. 101-102). * 

1. Noise : Any sounds created by the child which distract either 

another student or the teacher from the business at hand. 

The noise may be generated vocally (including "talk outs" or 

unintelligible sounds) or nonvocally ("tapping a pencil" or 

"snapping fingers"). 

2- Out of place; Any movement beyond the either explicitly or 
implicitly defined boundaries in which, the child is allowed 
movement. If the child 'is seated at his desk, then movement ^ 

• . « 

of any sort out of the seat is "out of place." 

3. Physical contact or destruction ; Any, contact with another 
person or another person's property which is unacceptable 
to that person. Kicking, hitting, pushing, tearing, break- 
ing, taking, are categorized as. physical contact or dest^ructlon . 
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Off task : Any movement off a prescribed activity which does not 
fall Into one of^ the three previously defined qategorieis. "Look- 
ing around," "staring Into spacg^" "doodling," or any observable . 
movement off the task at hand is Included. 

Some teachers may find they can malce such a record while teaching or 
carrying out other academic tasks. Most will find they will need the 
Issistance of an aide, the principal, or a school {Jsychologlst • Deno and 
Mlrkln suggested that this procedure' be used to help spot crlotlcal areas of 
problem social behavior* More specific pinpointing of behavlbr patterns for 

^ — 7 

change would then follow. . . ' 

^ Deho and Mlrkln also sugges ted recording behavior continuously, 
that* is, noting each occurrence of one form of the behaviors. This Is called 



frequency or evjent recording. For accurate recording, events must have a class 
beginning and endln^polnt- Not all behavior of Interest can be easily divided ^ 
Intoj^uch units. Anyone wishing to make the use of this system less difficult 
could specify observation intervals of one minute or 30 seconds. The record would 
then consist of the number of Intervals in which the behavior pattern , was observed 
to occur (Fig. 2), a number that usually will be less thaif«the actual frequency, 
of occurrences. 

f 

1st mln. 2nd mln. 3rd min. 4th mln. 5th min. Total 
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Figure 2. Oqffurrences of "off task" behavior. 
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The observer's task is easier When exact frequencies are not tallied, but 

some information is lost. Neither of these procedures provides an accurate 

measure of the duration of behaviors, which may sometimes be of Interest. 

for each application, observers must ask themselves how much detail is . 

usef ul> There is no reason to collect more observational data than can be or . 

will be used. 

A LONGER PUPIL OBSERVATION SCHEDULE ^ 

Previously in this module, the writer stressed the desirability of 
limiting the actual observation record to observable behavior while 
leaving inferential and valuing statements to a discussion section of the" 
record or adding them as commentary. The critical teader may have noted that- 
evaluative terms tend to creep into checklists and behavior pattern descriptions 
such as those mentioned. "Noise," in the Deno/Mirkin category |ystem, is 
"sounds which distract ...." (p. 101). "Physical contact or destruction" is 
"contact which is unacceptable (p. 102)." Interpretation of the terms underlined 
requii^es a value judgment by the observer. 

Records of the^cidenc^ of behavior patt^erns to which such inferential 
judgments have been applied always should be somewhat suspect because any ^ 
inference reduces Interobserver reliability; that is, people usually will agree 
about the times they, hear a studet^t speak to a classmate but sometimes will 
disagree about whether the verbalf^tion ^as . "positive", or "negative" in intent. 

The Pupil Obseirvation , Schedule i(POS), a pro cedu^ developed by the 
author (Wood, 1973, 1979), has several categories that require observers to 

infer whether a student's pr teacher's Intent is positive or negative. The PQS 
permits recording the occurrenU of 13 categories of student behavior by one-half- , 
minute intervals . The o]>s^rver makes a check mark^the cell ?or each half-minute 



■ • ' ■ ■ . ^ 

\ 



whenever a behavior pattern occurs one or mor^ times during that interval. This 

f " \ . ' » ■ . ■ ' ■ ■ ^ . 

method results in some loss of data, as illustrated previously, but after several ^ 
observation sessions a satisfactorily complete picture of student behavior can 



be obtained. With this type of system, it is customary to summarize the observa^ 
tions as percentages Xnumber of Intervals in which a behavior wa3 observed to 



occur Aotal number of intervals in the observation session). The percentages 
have been calculated on the illustrative POS form (see Figure 3) which shows the 
record for a lO-minut^ observation session ( 20 30-second interv^s) . 

The first four <ia tegories of behavior recorded on the POS can be obj,ectively 
defined: "on t,ask," ^'at plaoe," "object noise," and "vocal noise." ("Off task" 
is included so^that the observer always will have to mark a student as "on" or 
"off task, th^s marking off an. interval even if no other activity Is observed.) 

it • ' ' 

"Non-response; to- a behavior Initiated by another is also a category that requires 
little inference from an observer. But "self 7initia ted verbalization," "responding 
verbalizatlotts^"gesture, " and "physical contact" must, be judged either "positive" 
or "negative" in intent. Some objectivity of recording has ^efen sacrifled in the 
interest of reducing the number of categories. 

Observers can learn to use the POS with only a little practice, ftecause of 
the long t.ime intervals, observers usually find it possible to elaborate on the 

• f \ 

record with brief narrative comments as shown in the example. The procedure 

1. . ■ •• . ' 

• • r • , • .. •. . . ■■. • ■ 
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Vocally geiierated noise 
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Timei 10:15-10:25 a.m-. 



Date: 12/3/78 



Activity: Arithmetic period. 

Teacher is demonstrating 
problem solutions at chalk 
board. ^Students are volun- 
teering answers and responding 
to teacher questions. 



Room: 203 - Grade 5 -- Mr. B. 



S: C.N. - Male - Age 11-4 



Figure 3: Pupil Observation Schedule (Wood, 1973). 
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requires the observer to be free of other responsibilities, however. It has 
been used successfully by resource or consulting teachers as part of their 
assessments of problem behavior in regular classrooins (Rardln, 1976)- Rardtn 
supplemented the pupil categories by adding five categories of teacher behavior: 
"control," "organize," "discuss," "demonstrate," and "describe." She also ^ 
provided space for recording if the teacher .att:;jBnds positively, negatively, or 
not at all to the target student during each interval. Her modifications illustrate 
the desirability of fitting any procedure to the needs of the observer. 

Teachers seem to find the information recorded on the POS and similar %■ 
schedules useful in helping them to think about strategies for managing problem^ 
behavior. It provides a more complete and continuous record of observed behavior 
than lists ot behavior descriptions/objectives, but the record lacks the obvious 
implications for instruction that behavioral objective checklists provide.' The 
purpose of an observation schedule such as the POS is to give a general picture 
of the stud^t^s functioning preliminary to focusing in on 3pecific behavior* , 
patterns of interest or when monitoring progress over time. The POS record 
covers a wider range of behavior than the Deno/Mirkin "four category" procedure 
and Includes a record of positive as well as negative behavior. Walker (1979) 
describes application of similar observation systems to pupils acting out 
behavior* However, it requires somewhat more skill from the observer and cannot ^ 
be used by a teacher who is simultaneously carrying on instruction* By now, it 
should be clear that "observation" can be, in fact must be, shaped to fit one's 
needs, skill level, and time schedule. Activity 2, attached at the end, of this 
section, of the module provides students with experience in using the Pupil 
Observation Scale. Aftfer that experience it may be useful to discuss with 
students these issues. 



ADDITIONAL DATA THAT MAKES THE OBSERVATION RECORD MORE USEFUL 

When used by a practiced observer, the n&rratlve record procedure produces 

a very, completie xecoyd of behavior in Qont^^^t which is relatively yuahiaQed. hy 

preconceived categories. Description can be kept well separated from inference 
most of the time, although as illustrated, it would be false to claim that subtle 
observer biases do not influence what goes into the record. However, the full 
narrative procedure is difficult and Xime^j^nsuming to use,, and a narrative 
record is not always the mogt useful kind of^ observation record for the teacher 
since the data recorded is ^difficult to summarize and apply to the solution of 
instructional problems* One problem facing observers, theti. Is how they can 

restore to Observation records as much as possible of the context captured in 

\ ■ V 

a complete narrative record. ' ^ ^ 

One constructive step is to prepare a brief narrative description of 

r 

the classroom environment, the activity being carried on, and the chaTracterist ics 

* ] 

of the students and teachers (i.e., age, Sex, socioeconottiic status, ^d skill 
levels), in addition, observation records should be made of the behaviors of a 
random selection of the target student's same-sex peers. A common procedure is 
to alternate observations o'f the target student and individua^ peers; that is, 
observe the target student for 5 minutes, peer one for 5 minutes, the target 
student again for 5 minutes, peer two for 5 minutes^ and so forth. Studying 
such a recorfi helps one judge the "normality" of the target student's behavior. 
Forness (1979, attached iq^'this module) describes ways of collecting and using 
such normative data. As already mentioned, Rard in found it helpful to include 
a partial record of the teacher's behavior on the POS form, thus adding another 
piece to the description of the context in vhich the studentfs behavior occurs. 

Although the Pupil Observation Scale provides a way to start^ecording' 
observations of social interaction in the classroom, tVie other observation 
recording procedures described in this tnodule have tended 'to^ focus oh the indivl- 
dual student. Recording interaction is more difficult but, as Strain* Cooke and 
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Appolonni (1976) "have pointed out> interaction data adds much to ^n observation 
reeord. As an observer gains in skill, he/she finds ways to add important notes 
on social interaction to the record by annotation or modification of the form 
being used. 



Below is another simple* proqedure to record interactions— between ^ma 11 — - 

^ .' ^ 

groups of individuals. An observer can draw a circle containing the names pf 

each student being observed and draw arrows to show the direction of an interaction, 

as shown in Figure 4. Keep a running^ally of positive (+) or (-) interactions 

; ■ ■ ^ - • ■ 

during the period of observation* > 




Figure 4. A method of observing social interactions in classroom settings. 

' ■ •• . ' 

The same procedures that have been used to record the behavior of individuals 
can be used to record group behavior. A group record is simply the sum of all 
the individual behaviors o^ a particyiar kind, for example, "verbal offers to > 
help," or "physical assistance". Such group summary records can be used to ' ^ 

plan interventions to change group behavior and monitor their effectiveness or 

to place' individual bel>avior In context. Usually the total number of behavior 

o . ■ . ■ 

* • '' ' ' " * 

patterns to be observed and recorded is kept small or the record is made only at 

'* ■ 

a specified time interval, for example, a record is kept of • the'' number of students 

■ ■ ' ' , ' •« 

"off task" at each quarter hour. , 
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Reliability . and Valid;|.ty of Observation Data 



Jhe easiest way to ^hake the corifideuce of tlie novice observer to whose 
needs this paper has been addressed, Is tp ask hlin or her "to demonstrate the 



reji^ibility and validity of th/^lr observatlpn record." Records should be as 
reliable and valid as possible, but like so much else, the necessary degree 

of reliability and vall,dity varies- with the particular application, 

J ■ 

' i ■ ■ .. 

The reliability of a record Qpnceirns the accuracy with which it has been 
made* Only subjective estimates can be made of the reliability of narrative 
records. Reliability of count data (event or interval) is usually reported as 
the percentage of observer agreement. The easiest way to calculate this percentage 
from event data is to divide the smaller number of occurrences recorded by the 



"3 

■ .eg 



'^1 



1 



larger number of events recorded by two observers during the same observation period, 
then multiplying by 100 to convert the ratio obtained to a percentage. Example: . 
Observer A records a student as ^'off task" eight times during a ten minute 
observation' period, while Observer| B records the student "off task" only six 
times. Their inter observer agreement isionly 75%, which is. not particularly good 
reliability. An agreement of at least 80% is generally considered desirable. 

Jf several behaviors are being obseryed simultaneously^ the percentage 
of agreement can be determined for each behavior . Theise percentages can be 
averaged to give an estimate of reliability overall. Such p percentage 
gives equal weight to all of the individual scores, and since reliability of 
observation and frequency, of occurrence will vary for each behavior, a weighted 
average iiiay be 4ealrable, ; Boehin and Weinberg (1^77) . descrtbei a simple procedure -.y^^ 
for calculating such a weighted average;^^^ procedure is ialso useful for 

determining the percentage, of agreement when triore than two observers are being 
-compared. - " ^ ^' ' -^'Vlit- • " " ■ • ' " ■ ' 



A'be^tter way to calculate intetab^servet agreement fox interval data Is 
to divide the tota'l number of intervals less those where there is disagreement 
by the total number of intervals, then converting this tatlo to a percentage. 
Exampl e; Observer A and Ob server B^g ree thaiL-J:h.e^A4:^udeQt— they—obR^rved w ap; ' 



"off task" during eigh^ of ten interval^^ but Observer A marked one interval B 
did not and B marked one interval A did not mark. The percentage of agreement 
in this case is 8/10 or 80%, ^ ■ ' ■ ^ . 

If the percentage of agreement is less than 80%, one may suspect that the 
events to be recorded were poorly def ined;^j;„so that different observers 
^interpreted their occurrence differently, that too much Inference was required^ 

in deciding whether or not a particular event occurred, or that the mechanics 

. _ , . . . . * ^ ■ ■ - - 

of tfhe recording procedure were so complex as to cause ^observer fecordiTig 
errors. If the system does not have major flaws bf these kinds, reliability 
can be Improved by practice. ' . ' 

Reliability places a limit on the validity of observation records. Validity ^ 
is the trut*hf ulness of the record* Does the record describe what actually happened? 
If the description is inaccurate, it is clearly not valid. But validity is also a 
affected by other fa^etors. For example, a valid record would have to be a complete 
record. In this module, it ha,s been suggested that observers should only collect 
data that is useful. This practical adVice clearly places a limitation on the^ 
validity of the records obtaine^d. Inference also affects validity. For example, 
even though two observers may agree that rf^student^s behavior reveals "depression" 
or "anxiety," a third observer may feel that the same behavior should be interpreted 
as "anger." While this may show up as a reliability problem, the fundamental problem 
is one of validity. Thus, an objective descriptio^ tenf^ to be more valid* Yet, ^ 
to make use of the data, someone mu^t Interpret and value it. 
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Obviously observers must be concerned about the reliability and validity of 
their records, but not to the point of giving up the simple methods of observation r 
recording that have been described/ Despite their technical flaws, the chances 
-a re g re £Ut-~thAt~^recoir4s-^Juade u glu g-^haae-jnathods a r e- mn re. r ellahle and valid „Jjianj 



the haphazard ^^^1 written anecdotal records that too often provide the founda- 
tion for decision making and evaluation of individual "^nd group educationail'programg 

USING OBSERVATION RECORDS 



A variety of procedures to guide observation and make a record of what is 
observed have been described In this paper. How does one decide vJ^lch procedure 
is most appropriate for a specific purpose? Some teachers may prefer to adapt 
the same basic procedure to meet every needj but In general, it is better to 
master several different approaches so as to have a range of choices when seeking 
for the "best fit." Perhaps, members of a school faculty can pool their expertise, 
some becoming experienced with one recording procedure and others with another • 
Here are some possibilities. 

1, Using observation for screening and i nitial assessmentr Gbser^a^lett-ls • 

an important tool for use in answering the first question teachers should consider 
when they first notice 'that they are "disturbed" or concerned about a student's 
behavior: How specifically can they describe the behavior that Is disturbing . them? 
Careful deiscrlptlon must precede decisions about when and how to :j.htervene, or 
when and to- whom to refer. Brief ^narrafive notes taken after the occurrence o^ 
"critical incidents" can be of help in pinpointing the problem, but early use of 
systematic observations such as the Deno/Mlrkln ."four category" procediire, or a 
form of the Pupil Obj^ervation Schedule will provide data on the "typical" as well 
'as the 'V^oblem" behavior. Both should- be considered. Use of these procedures 
can «nd probably should be relatively informal at this stage. 
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- Aft^r the teacher begins to feel more certain about what specifically is ^ 
the behavlb'r thdt disturbs him/her, the neict important question can be addressed; 
Is the behavior sufficiently cllsturbing to the student, the group, or to the 

:^ea&he^c-to-warrant;-plan£u1 attemptfl tij__chaLngj£.-thaJ: behavior? Most prob lems will 

respond to good classroom management procedures; many are transient and seem to 
be "outgrown" without special attention. Is one reasonajjly certain this iff one 
of the small number that requires a special plan? If so, procedures described 
in the modules in this series dealing with topics such as referral, assessment, 
development of individual and group behavior managemfntv procedures and the 
development of behavioral objectives and Individualized Educational Programs 
(lEPs) should be undertaken. ^ 

2 . Formal assessment and the development of the Indiv idualize d Education 
Pl^; The systematic observation procedures that have been described under 
Step 1 are appropriate fot use ift formal assessment and program planning .as well. 
But, for these purposes, procedures like Wood's Developmental Therapy Objectives 
Rating Form (DTORF, 1975) and Hewett and Taylor's ABCs of the lEP (1980) become . 
particularly useful. Too often educators wait to use these procedures only after 
"the, studgnrtas-iTeen- pldu e a i u a-special setting. Since the relationship between 



changes in settings and changes in behavlor^s well known, it would seem appropriate 

■> * - 

to rate a student's behavior on such scales In the situation where the problem 
was first observed as well as later, after attempts have been madfe to change 

' ^ . ■ ■ 

his/her behavior or after the student has been placed In new or different 

0 

,^ituations. Such a "double baseline," if we may so te]^m*it, provides both a 
helpful summary of the student's original status and appropriate objectives for 

'the early stages of a behavior change program when a detailed plan has not been 
worked out • 

3. UsUng observation procedures to monitor progress : Several methods for 
^ obfe«lnlng frequent independent observations of pupil behavior have been described 

^ERIC ■ .,.;'.^\....>.. .. - 
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earlier. Data from such observations can be readily summarized on charts or 
graphs (Deno & Mirkin*, 1977). Thus summarized , the data pverir.it ongoing evaluation 
of the Interventions introduced to guide the social development of a target student 

or students and to provide the bas is for thoughtful progrnm dprlglong S44ch--44^e 

is described by Deno ^nd Mirkin (1977) as "data-based program moditication." 

A . Usin g observation procedure s to determine wha t to change vheh progress 
does hot occ ur; behavior change programs are usually focused on a small range 
of student behavior, for example, being on task or responding appropriately to 
social greet ingg by others. By thus narrowing the focus, there is a tendency^...^^ 
to lose sight of the "total person." While one response to a student's lack^of 
progress may be to^change the intervention plan while continuing to focus on the 
target behaviors, another might be to take a step l>ack, and look at the student^s 
behavior more generally, as was done in the earliest Stages of assessment. F^ocusing 
on targets or behavioral objectives, such as those on the DTORF> may be an impedi- 
ment to noticing that an individual student might respond better if approached 
^ - . * 

in a completely different manner. Going back to the use of a^eneral observation 
procedure like the POS may help to reassess the situation and develop new plans 
that work better than the old. 

5. Using observation dat a fo r th e purpose of evaludtion ; The advantages 
^of using charts and graphs to summarize observation data have already been 
mentioned in the discussi^ of methods for monitoring progress. Such data . 
summaries can also be useful for purposes of program or individual progress 
evaluation. Datd from behavior sequences like those of M. J^ood (1975) or Hewett 
and Taylor (1980) can be summarized in terms of specific objectives mastered 
by individoal students or number of objectives mastere^d by a group during a 
specified time period. Such data can be very useful in evaluating individual 
and grou^ program effectiveness. p 
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.. . . P 

A CONCLUDING COMMENT 



Slavln (1978) argued in a recent iasueSQ.f ttm EdMcatlonal .R egeargher > 
tjie opinion journal of the American Educational Research Association, that 



specla^ education programs have demonstrated mwch greater potency as Interventions 
fostering the development of students in part because of their attention to 
establishing a foundation of data gathered through systematic observation on 
which to base program planning and decision making. 

Several 'years of experience have convinced the writer that, systematic 
observation is the best procedure available to the teacher who wishes to gather 
useful information on the social behavior 'of students. The procedures may seem 
awkward and time-consuming at first, but with practice, they become easier to 
use. However, the most convincing argument is made by the observation records ^ 
themselves. Most teachers will find them useful enough to be worth the extra 
effort it may require to gather and maintain the data they contain. 
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Activity #1 - Karirative Descriptions 

■ ' , r 
Narrative descriptions of the behavior of a student In a classroom 



situation Is a useful method of aassessi/ng that student's behavior. Fox: 
-studervtrt^tinL^^ hy 
writing narrative descriptions can also help develop general X as opposed, 
to formal) observation skills. Activity 1 provides a handout for teacher 
education students to help them develop the "objective frame of mind" 
needed for. writing good narratives. Also included is a sample form to 
help structure these observations. While videotaped or filmed sequences 
are useful for providing social situations to describe irf narrative 
records, especially when used as brief training sessions, students can 
learn much from conducting the observation in a "live" classroom situa- 
tion. 

For the jnirposes of this practice ohsirvation, students ought to be 
encouraged to observe one student for a period of at least 20 minut^ts. 
The following activity outlined for use in a teacher education program 
has been used with both regular education and special education students 
at the University of Minnesota. - ^ o ♦ 

L ■ . " ■ - 
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NARRATIVE OBSERVATION * 



There are two major concerns in studying ^n individual ' s behavior. One 
ig a factual problem: How does the person actually behave in a particular 
situation? The oth^ Is a theoretical problem: Why does he behave as he 
does? Answers to both questlQns are essential in arriving at an understand- 
ing. Misunderstandings arise, however, when th^ two processes are confused. 

/ ■ ; ■ • 

in general, a good narrative account of a person's behfivior should be a 
complete and accurate account of actual behavior, A perscm reading the 
record should be able to get the same basic picture of the classroom situation 
as the-^person who actually observed, it. A good narrative record should almost 
do what a' sound film does. Writing down the behavior of one student in , a 
classroom often seems deceptively simple* In fact it is a demanding task, 
especially when pne later attempts to make sense' out of the observations. In- 
cluded below a list of ideas J:hat will make a narrative description better 
able to communicate the observed behavior of the student. 



A. Things t£ djo - ; . • 

1- Include time and place pf observation and duration of actions. 

a. Between what times was observation conducted? " • 

b. Where was observation made, e.g., type of class, age of 
students, subject of class? 

c. Duration of Observed activities. (How long did-student 
cry, lay head on desk> do math problems? Where did 
student *go when he/she left, seat?) 

2. Describe the setting in which behavior takes place, 
a. VJhat were students expected to accomplish during observed period? 
b- How many students are in the class? How is q/ass seating 

arranged? 

c. l^Jho is leading the class? How is this, being done? 

3. Include relevant facts about student being observed, e.g,, age, 
sex, noticeable physical characteristics, dre^s, where seated. 

♦ ■ ■■ 

4. Include actual dialogue. 
(Not: Teacher sent student out of room and he^ refused, but: 

Teacher said, "Leave/the room immediately and don't conie back 
until you learn to behave." Student threw a book oti the floor 
and said, "1 didn't do it, and you can't make me go,") 

5^ Describe social relations involved, e.g., teacher-stiident , teacher 
aide-student , student-students 

6. Include full details of actual actions.; (Not: "He drew all over 

his answer sheet", but: "He worked four math problems , looked around 
the class for 15 seconds, then folded his answer sheet over and drew 

the outline of a naked woman.") 

\ . ■ ^ 

*Adapted from a tralnirtg module pr.epared by R. W. McCauley, Longfellow Treatment 
Center jvMinneapolis, Minnesota. 



Things to avoid ^ / 

1. Confusing Interpretations with behavioral facts. j-. 

a. Some of these interpretatlojtis are inferences about mot/ivatlons , 
such as: "He"wanted to," "seeking attention", "he wds trying 
to"... "he was interested in".., "he feels at home in".. ."he 
thought it was funny, so"... "he disliked." (Motives are not> 
desci^iptions of behavior.) 

b. Some of these interpretations are^ inferences about the observer's 
covert behavior;, such as" "he was daydreaming, ""he was thinkitig 

. about".. k"he Was unfamiliar with." (The focus in a good narra- 
tive description is on overt behay^<^rO 

c. Some of these^interpretations are in^ffect theories about 
behavior, such as: "he has a habit of", "it is in his nature fo," 
"he has learned to," or "he has been reinforced for." 

2. Labeling rather than describing. 

a. Some of these labels are "trait" names (ascribing behavior to 
hypothetical "traits," is but one kind of theory about behavior). 

b. Some of these labels are short-^hand pseudo-descriptive attempts to 
summarize behavior tathet than actual descriptions of behavior, 
such as "shy," "aggressive," "rigid," "stubborn," "inattentive," 
or "hyperactive/* They^ may seem descriptive to the observer but 
often mean something totally different to the person who reads an 
account of the observation. 

3. Evaluating rather than describing (related to labeling and name-calling) 

a. Some evaluations of behavior are p?ieudo-lnterpretative statements, 
generally loaded with the observer's feelings, such as, "spoiled," 
"trouble-maker," "well-behaved," "good student," "poor sport," 
"tyrant," "hot-headed," "mischievous," "dumb," "bright," or "dis- 
turbed." ^ -' 

Some of these evaluations are reflections of how the observee 
impreBses the observer rather than descriptions of what the observee 
does. Examples of this can be seen in observations where students 
are described as "likeable,'' "agreeable," "cooperative," ''friendly," 
or "humorous." ' 

4. Using words which communicate poorly 

Some terras do not describe, but only seem to describe. Examples of 
^ ^ these are "frequently, " "soon., " "a short time afterwards , " "large , " 
"small," "latef," and "close" or "far." (Some are actually incor- 
rect, such as "He Is always late," "He never works," et6.) 
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iie can agree that theorizing and interpreting is necessary. We can a,lso 
agree \hat" labeling is often convenient. Evaluating others' behavior and 
having our feelings a^ffect.ed "by others' actions toward us Is Inevitable, and 
at times, quite de'slrable," W<? also must understand, however, that confusions 
and miteunderstandings results when these processes are mistaken for .descriptions 
of benavior. • ' 

It Is also well to rememVer that the goal of a narrative description Is 
to write a factual account of a person's behavior, not a literary masterpiece. 
_If the] observee's behavior is monotonous, undramatic, or unspectacular, it is 
not the fault of the observer. 
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Actlvlt:y //I Narrative Observation , 

Instructions? Observe a -child or adolescent, In some kind of school setting, 
for a period of twenty (20) minutes. The subject of this observation does not 
necessarily have to be one whom you suspect of having a school-related problem, 

1. Timfi^: Twenty-minute observation period. 

2, Child ; The student should be a stranger of either sex. 

3* Setting: Any school situation. Acceptable places are: playground, 
sit nations, classrooms^ special classes such as music, gym or art, 
or other school activities. 

♦ 

Record : YQur written report of the observations should' contain: 

a- Description and factual statement of the social setting Incliading tiirae, 
place, and persons involved. • v 

b. Description of what is being done in the setting, including the task 
that the subject in the description is expected to be accomplishing. 

c. Description of the subject. ;^ 

d. A separation of observational records into four five-minute units. 

5. After completing th'fe record. Write an interpretation of the meaning of the 
interaction between the child and his environment. What goals, desires, 
needs were expressed by the child or may be inferred from his/her behavior? 
What did he/she learn? What was he/she prevented from learning? Why did 
he/she behave as was observed? At this stage one can (attempt to make . inean-- 
ing from the observational data. (As is shown on the (samp 1-e observation 
form a column for observer's comments is included* This is a space where 
interpretative notes can be made as one is writing or rereading the text 
of the observation.) ^ . \^ 

6. Procedure : Avoid giving the child and others he is interacting with the 
i^ea that they are being watched. Make, no personal contact with the child 
or the adults or* peers. ' 





Narrative Observation 



Da t e7 Time f : 7 ~ 
Social' Setting; 



Task: 



Subject: 



■.••",*?a, 



■ Mm 



Observation Record 



\ 



Time: 



Observer Comments 



Tinie: 
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(Subsequent paged nee^ onl^ Observation Record and ^Observer Cominents columns.) 
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Activity #2 ~ Interval Recording 

Interval recording of students' behavior has been found by many 
tieachers to be a useful means of measuring the' frequency of behaviors 
of conqern, of measuring changes in students' behavior over time, and 
comparing the frequency of one student's behavior with that of his/her 
peers. Many ^teachers find that interval counting of students' behavior 
is a very useful task for teachers' aides to perform and that the re- 
cording of thes^ observations serves as a helpful on-going, individualized 
assessment strategy. As with other types of observation, experience with 
formal observation procedures also serves as good training for the in- 
formal observations that teachers are making every hour they are in the 
- ' ' ... ^ 

classroom. » . * 

For the purposes of direct observation, interval recording of behavior 
a form of the Pupil Observation Schedule has been provided. Basic in- 
structions for using that form are attached. Although relatively 
Straight-forward it should be impressed upon students that considerable 
familiarity with the category definitions, ^their placement on the form 
and the recording system itself will make the use of this instrument 
much Inore easily accomplished. It is also possible that some students ^ 
might wish to develop their own observation instruments. This, of 
course, should be encouraged and the category definitions On the Pupil 
Observation^ Schedule should help^ thqm formulate definitions for their 
own categories.^ 
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PUPIL •OB$ERVAT10N SCHEDULF. (Fo^in B)* 

— Before beginning to observe, the observer should fill in na;ne end date.. . — 

Running notes about student characteristics, the setting and the activity, 
can be taken during the observation, but the final statement should be written 
i at the close of the observation. 
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All boxes (behavior descriptions) needed to describe the performance 
one or more times of a target behavior pattern by the student being ob- * 
served during each 30 second'observation period should be marked once with^- ' 
the appropriate symbol in the vertical column for that period. (The present 
fomi has 20 columns, enough for 10 minutes of observation of one student.) ,.•,) 
Use spaces between the lines on the form to write in cjescriptions of spe- ,v| 
cial behaviors aoted if ,jiot otherwise coded. ,| 

Record a1J_ve^rbal and phys ical interac tions as posi tiye jmjlejs^^e^^ 
neqa;.ive in intent and/»"or' effect on others. 

Symbols:- A check (y) indicates the occurrences of a nondirected student 
behavior or, in the interactive categories, the occurrence of behavior in- 
volving either the teacher or the group as a whole including the teacher. 
For some categories, special symbols are used to record frequently occurring 
specific behavior patterns. These symbols are usually lower case letters. 
Use of these "special codes" is optional. * ^ 



CATEGORY DEFINITIONS 



ON TASK: Student is "attending to task" or "working." Eyes are ;^ 
d'irectcd toward task crca. Task, area can be away from desk and/ 
or involve movement. Work" could be a game or other activity. i.-; 
A student who is not attending to task may be "day dreaming,'" j.;.^; 
'•'playing, ".or engaging in some other activity. Try to make a narra- 
tive note on the" specific non-task activity if time permits. 

. ■ ■ ■ ^ M 

AT PLACE: Student is at teacher-approved place* usually at desk or 
table. Buttocks touching chair. Special codes: "T" when student 
turns head, shoulders or pelvis 90 degrees or more from "correct" 
task orientation for more than 4 seconds. "R" when student is , 
rockingyin chair so that one or more chair legs leave floor, A 
narretive note may be useful if "place" is away fmm usual work area. 
A student is away from a teacher-approved place when his or her 
buttocks are off the chair for more than 4 seconds. The behavior need 
not be "off task." Make a note if the stude^it leaves the room and U 
resume recording when a student returns. 

POSITI VE VER BAL INTERA CTION : Positive verbal interaction may be self- 
initiated or responding.. Examples would be when students express . v:j 
verbal support for a peer or the teacWer, ask constructive questions, 
give suggestions, offer ideas oji topics being discussed, respond - . 
to teacher or peer questions, recite, and acknowledge help siven by :| 
another. Special Code?? Mark "X" -if a verbalization Initiated is positive,.;:; 
tn intent but "comes the wrong time:" If tTine permits, note 
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^ *0rig1n<il version (1973) by Frank H. Wood,. Special Education Programs, 

o M.vcrlsfy of Minnesota, Minneapolis, MN 554(i5. Revised 1979. 
ERIC . V • 
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.spedllc-mrds^M^ 

students other behavior. ^ 

TEACHER INTERACTION: Teacher interaction with the target student is 
recorclecT as either positive or nocjative. This interaction may be 
verbal or nonverbal. Although the focus is on an individual 
student, records of the teacher"*s behavior directed toward the group 
of v/hich the' student is a part should also oe recorded here. Task 
description and i ns true tior^, as well as verbal praise an<^ encourage- . 
ment» are to be recorded as positive (h). Criticism and threat are 
recorded as negative, (-) . Absence of marks in either of these cate- 
gories during a single interval is an indication that there w«s no 
teacher interaction with^the student during that time. 

NOISE: Noise is recorded whether generated by the use of objects or 
the voice. Examples of object-generated noise are making a noise 
with the hands (drumming, pounding, clapping, etc.) or a hand-held . - ' 
object (pencil tapping, noisy scribbling on paper, crumpl'ing paper, 
etc.) Vocal noise is when a student makes a noise with xtie mouth 
not directed specifically at others(humming , singing to self , shouting 
out, tumbling, whistling, etc.). Record the occurrence of noise if 
in the observers judgement, the noise is audible to others in the group. 

NEGATIVE VERDAL I NTERACTIO N: Negative verbal interaction may be self- 

iniffeted or a "response to statements bj^thers. Examples of the first . 
aree would be student-initiated complaints about or criticism of the 
behavior of oi:hers. Also student verbal threats. Responaing negative 
verbalizations arc those made in response to statements or gestures by 
others or as part of a continuing dialogue or discussion, ' 

NEGATI VE PHYSI CAL CQNTACTf Student hurts or interferes, with the activity 
of another Fy touchfng him/her or his/her work or py'operty. Student 
attacks another using hands, feet, or object either* thrown or held in 
hand. 

IND IVIDU AL B EHAVIOR : Space is provided where a record may be kept of an 
individual student behavior which is of special interest. 
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REMEMBER TO SUPPLEMENT SYMb()LS BY JOTTING IN A WRITTEN DESCRIPTION OF SPECIFIC 
BEHAVIOR OR THE WORDING OF ^VERBALIZATION WHENEVER JIME PERMITS. 



w 

. PUPll ODStRVATJON SCHEDULE (FORM B) 




OBSERVER 



DESCRIPTION OF STUDENT. OBSERVED: 



DATE 



^DESCRIPTION OF OTHER PERSONS IN SETTING; 



it 



*DESCRIPTI0N OF SETTING AND ACTIVITY: 
■> \ 

*(During tliis 10 minute period.) 

1 2 3 



8 



10 



ON TASK 



IXI 



AT PLAGE 



PO^rriVE VERBAL 
INTERACTION 



TEACHER (f) 
INTERACTION / v 



! : 

> 










^ i 

• 


r 


• 


• 


1 : 


• 


• -• 

• • 


* 


• 




: ■ 


1 





NOISE 



NEGATIVE VERBAL 
INTERACTION 



Girzi 



"T~ 
I 



NEGATIVE 
PHYSICAL 
CONACT 



■nnir 
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ABSTRACT 

her classmates is olten a resson 'o^'"'''^'^^^^ observations o/ 220 cMdren ■ 
is evsilableupor. .iuch to ba^o ^^^^J^^^^^ ovor sevo.al days 

in 19 class s for the educal.or^ally Means and. 

to provide a tentative •^o-'«''^<^ f ''^7;;^;;;:";;o.t^ Xl, ^'^Hh t.acbor 
standard d^vist.ons wore ex^«ned 'T ^^'^^ .^^^ ,oA.<luoncie^ ol 

to on-task t^ehaviors, 

behavior In .he classroom se.rtng B^^^^^^^^^^ l°'d R °y, 1972). Althougl, 
and Esvold.. 1974; Ne son, ' f^^^f;";;4°;;,f ° B^.eUne Iroquency o( prob- 
direct Observation Is then "J^f ° =;''-;°'f,^3°ln, (Forness, 1?70; Stra.n, 
lembelravlor, and to 7,='"^'^ '' ^^a.lc ^ Siven to a 

Cooke, and Apollon, 1976-). fY^^^™''^^^^^ classroom. Only recently 
child's behavior relativo to o<ii«f <^'>''^™" "l"™ „olinn the behavior o! 
have investigator, begun <<;.*"'P °V a system ^^^^^^^^ 

has been -^11^"^^^"^^ 

1976); Greenwood. '^f^\l"^^ZV", Z;lZ of children in regular 
.While a lew in<'«5«'ga'°'f and ISsvoldt. 1975 a and b; 



continuo to Require treatment for behavior problems (Darr and McDowell. 
1972; Fink. 1972; Haubrich and Shores. 1976). As has been suggested in 
other areas of assessment (Gun?^burg, 1973; Mercer and Lewis. 1977). it 
Is often helpful to have aMrame of reference which also includes normative 
data for "specjar populations. 

The present study describes expected levels of observable classroom be- 
havior for children in a-relativoly representative sample of classes for the 
educationally handicapped. These classes contain both learning disabled 
and emotionally disturbed children and represent the special class .place- 
ment mpst commonly used In California for children with behavioral prob- 
lems (Hansen. 1970; Keogh. Tchir. and Windeguth-Behn; 1974). The ob- 
servation technique used was developed from previous work on classroom 
intervention [c.t, Forness! 1975), and includes behavioral categories rele- 
vant to intervention procedures, such as off-task behavior and classroom 
disruption. The technique has also been used to describe behavior of 
educationally handicapped children in regular elementary classroom set- 
tings (Forness and Esvcldt. 1974^ 1975a). and to identify young children 
at risk for subsequent educational handicaps (Fornes3 and Esveldt. 1975b; 
Forness, Guthrie, nnd Nihira, 1975; Forness, Guthrie, and Hall. 1976; 
Forness, Hall, and Guthrie. 1977). 

METHOD 

Participants and Settings 

There were 220 chV^ren observed in 19 classrooms for the educationally 
handicapped selected from among three different counties in Southern 
California. Those children rroresonted 1 .2 percent of all children the same 
age enrolled in such classes in California. School districts represented 
as closely as possible the demographic nriix irt large and small districts, 
urban and -suburban communities. Specific breakdown, however, was un- 
available on ethnic minority variables. 

Class size ranged from nine to 14 with a mean of 11 .5 children per class- 
room (S.D. = 1.9). Age of the children ranged from eight to 13 with a mean 
of 107 (S.D. = 1.4). Seventy percent of the samples were males. All par- 
ticipants were observed while enrolled in educationj^lly handicapped 
classes during the spring of t977. As indicated above,! all .had ^been re- 
ferred to those classrooms because of learning-disabilities and/or behavior 
problems in the regular class. 

i ■ ■■ r 

^Observation System 

Behaviors were recorded In four categories: Verbal /nf^racf/on— defined 
* as task-oriented verbal or gestural attempts to communicate, such as ask- 
ing questions, reciting, or raising hand; on-task behavior —dofmed as eye 
contact.J^o teacher, task materials, or peer who is recitincj; of Mask behavior 
— dcfin^ as eye contact to other than above; and disruptiyeness—de- 
lined as behavior incompatible with on task activities, such as talking to 
peers when not permitted* speaking out of turn. tIjTowing objects, verbal 
or physical aggression, etc. Categories were treated as mutually exclusive, 
i.e., only. one could apply during an interval. 



Behaviors we.r^fllso rgcorded under ono of throe conditions. If the teacher 
or a poor happened to bo attending or responding directly to the child 
during the interval, the behavior was recorded under respqnso 
or poor response; otherwise, behavior was recorded under no response. 

A time-sampling procedure was used involving six-second intervals marKed 
off with red tape on ai^tgp watch attached to the observer's clipboard. 
All.children in each classroom were observed in round-robin fashion ac- 
cording to their order of appearance on the data siieot. During each six- 
second interval, the observer located the next child On the sheet, observed 
long enough to form a menial image of the behavior, placed a tally by the 
appropriate behavior under the corresponding response condition, and . 
went on to tlie next child on the sheet. Observations continued until 10 
rounds had been made on the classroom for the daily observation period. 

Six different observers v/ero trained in two group sessions lasting a total 
of six hours. Both paper and pencil reliability exercises and simulation 
conditions were used. Particular emphasis was placed {jn protjioms of 
reliability and observer bias (Mash and McElwee, 1974; Taplin and Reici. 
1973- Wahler and Leslie, 1973). Observer reliabilily was checked by two 
obse'rvation supervisors previously trained to criterion over several ses- 
sions by the author. Reliability checks were made during the first two 
weeks of data collection. Supervisors recorded data fnultaneously with 
each obseivSwthe same group of children. Reliabil% confficients were 
computed by dividing agreements by the lotat of agreements plus dis- 
agreements. These averaged .69 with a range of .83 to .93 for all obseivers. 

Procedures / 

All classrooms were observed, as much as possible, during the morning 
hours at a time Wh,en all children were either functioning as a group or 
were at least-engaged in i similar type of activity, such as seatwork. Defore 
observations were begu,h. each observer spent at least one day m the 
classroom learning children's names from a seating chart, becoming ac- 
customed to classroom routines, and doing a tprief "practice round " of 
observations which was not counted in the data. This allowed time for the 
. children and teacher to get usee! to the observerls presence, as suggested 
by IVIasling and Stern (1964). , 
An observer continued observing an assigned classroom'unlil that par- 
ticular classroom' had bsen observed a minimum of four days, a period 
suggested as necessary i'or a stable measure of children's classroom be- 
havior (Forness and Guthrie. 1977). Although all children were observed 
for the same amount of time each day, they^were observed for varying 
number of days so their individual totals in each category were converted 
to percentages^ , v " 

RESULTS 

Mean percentages of l)ehavior in each category' and response condition 
are presented in Table 1, along with standard deviations. GuUiects en- 
gaqcd in ^.i^propria^c classroom behiWior. the total verbal interactions 
plus on-task behavior. 02.8 percent of the time (S.D. - 14.3 percent), rang- 
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TABLE 1 

Mean Percent of Behavior Observed Uade.r Three Posponse Conditions 



Teacher Peer 
No Response Response Respohse Total 
Mean (S.D.) Mean (S.D.) Moan (S.D.) Mean (S.O.) 



Verbal 
interaction 


1.6(3,4) 


9.9(10.6) 


1.9 (4,2) 


13.4 (12.0) 


On-task 
befiavior 


*, • 
63.4(18.3) 


3.6(4.5) 


2.4 (5.0) 


69.4 (16.2) 


OfMarsk 

behavior 
Disruptiveness 


11.5(10.8) 
1.8 (3.8) 


0.4(1.5) 
0.8(2.1) 


1.5(3.1) 
1.1 (2.8) 


13.4 (11.9)- 
3.7 (6.4) 


Total 


78.3 (13.8) 


14.7 (11.5) 


6.9 (7.3) 


100.0 



ingfrom 21 to 100 percent. The level of disruptiveness rangod from Oto 47 
percent. Tho mean time which teachers were observed In response to 
children's total appropriate behavior was 13.4 percent (S.D. - 11.4). ranging 
from 0 to 60 percent. For peers, this same figure wa» 4.3 percent (S.D. 
= 6 8) ranging from 0 to 50 percent. For total inappropriate behaviors, 
the response ranged frc.n 0 to 23 percent for teachers and from 0 to 24 
percent for peers. i 
The only significant sex difference was that boys were more -Jisruptive- 
than girls under the "nojresponse" condition (unpaired f test with unequal 
variance, t = -2.83. p§'.01); but the actual percent difference was negli- 
gible. There were not apparent relationships between total appropriate 
behavior and class>size nor between this behavior and age {rhq - .04 
and -.14. respectively).. 

' DISCUSSION 

The findings seem to suggest that any child whose percentage oJ appro- 
priate behavior (verbal interaction plus on-task) falls much boloy/ 70 per- 
cent begins to be at risk for behavior problems.. It is when that level begin? 
' to reach 50 percent that intervention would seem warranted. Dependmg 
on the^case. figures on disruptive behavior may be more to the point. 
A child whose disruptiveness is over 10 percent becomes at risk, and 
any child much over 15 percent becomes a candidate for intervention. 
Some caution should be used here, however, since the disruptive category 
provides no distinction between behaviors pf high intensity but low fre- 
quency, e.g.. aggressive Or assaultive behavior, and disruptions which 
are seen as less immediately troublesome (Gcston, Cowen. DeStefano, 
'and GallagTier. 1978). These figures are of course, limited to educationally 
handicapped classes as defined herein. / , 

Hdw these figures are used from classroom to classroom \\ilh individual 
educationally handicappod cliildren is another matter. There vyere some 
classrooms in the safjiple where literally no children were oven '0 the 'at 
Visk" range and one classroom where (wo of the ^0 children .appear to 



need immQdiato Inlerventipn. The quesUpn of t^^^ ~ l^f^'"^^ 
oae' but normative data in this cas^ might assist a teacher, for e:iamp e 
frToiess nq his or her ca's^"<or'additronai liolp in the classroom or referral 
or'trea r^ent Jfcctiver^ess of SMbscquont treatment or intervention could 
hen be g'ven additional credence, beyond the child's improvement over 
hi or her own baseline, whenever levels of appropriate behav.or beg.n to 
rise substantially above 70 percent. ^ • 

Another monitoring point could be levels of teacher oi- peer response^ 
Fo°exam^^ whenever a child appears to receive attention more than 10 
ne cent3 he time from peers for inappropriate behav.or con mgent use 
orpee attention and ignoring (c.f.. Patterson. 1974) might be seen as 
?he treatment of choice. Unfortunately, these data do not seem to be par- 
t cu ly useful for identifying socially isol^ed children (Gottman 1977: 
GreeZld. Walker, and Hops, in press) since no peer response at all 
stm appear; to be In the noro^al range. It is interesting to note the ap- 
plnSy eS^^ distribution of teacher attention in -^^i^V'^u ^'LTh 
perr^reCond 10 times more often to appropriate behav.or than they do to 
Inappropriate behavior- 

cT6,T^Xep,Ltn^ sample in levels of Sppropriale behavior.. An une.. 

oecleTf nd ng is lhat levels o( children's appropriate behavor ,n educa- 
Jon* handilpped classrpoms .end ,o ec,ual ,ha. found^o^^^^^^^^ 
-f^dren In regular classrooms (Forness and Esveldt. 1974. ^.mnrie 

■:rar;Scr^= 

re^p'^r rb^ 0^=; T^:^X 0= 

settings. ^ - . 
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In striking conlrasi to a 1960 repoit in which only 8%. of the 
empirical studies in child development literature appeared to be 
based on dbservaiiojial data (Wright, 1960)^, recent educational and 
behavioral science vvriiings canlain many observational researches, 
Elhologists Ore now applying their animaborienlcd techniques to the« 
study of hunnm behavior. Periodicals HJkc the Journal of Applied 
Behavior Analyyis have been intipduced to provide publicatij^ out- 
lets for behavior modification studies and single subject rc»irch, 
After years of laborjiuis work making specimen records of child 
functioning in iKUural environments, ecologists are c attracting an 
hicreasingly brpiid audienec of educators interested in both their 
findings and procedures. Would-be investigator^^ nov.' can select iuicr- 
action scales from a vast airiiy of possibilities. The 73 elassrooni ^»calos 
reproduced only receiuly in, the Mirrors for BJutvior collection,. 
(Simon Doyei; 1967, 1 970) no lonpef represent even a maiority of 
the i!)struments available for siudyinji teacher beliavior, noi to mention 
numerous scales for child behavior and other observation targets. 

The current and tuture trend': stressed in this Conference stem tVoiTi 
deep, historical roots. The writings of Darv.'in, G. Sjtanley HalK Gescll, 
Lorenz. Tinbcrgen, Dorothy Thomas. Harold Anderson. Robert Balt^s. 
Herbert Thelcn. and Hartshorne .^c^nd May spring Inmicdiately to 
mind, as do the early anthropological studios pf primitive cultures by 
the Jikes of Boa/. Benedict, and Ntead, and of communily^fc by 
WapTCr, HoUinpshead, William Foote Whyte, and many others. h\ 
edtication. the work of Daniel Prescott and his staff at the Universities 
of; Chicago and Maryland perhaps highlight the child study move- 
ment in America. The cofitributions liaye been cof\tinuous aiul addilive ^ 
over iwo and three decades foi^poople like Kov.erl3arker, Donalijl^ 
Medley, Jacob Kounif), Ned Flanders, and Phil Schoggen: and over 
five decades for Jean Piaget, \\ho published lus first v/orks based on 
child observation in tlie early I920's and whose child development 
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■ and commereial ins,itu.ions to Mudy .".K- ami mo «>,> 
oDorations and parlicipalory n«.nagc«ieiu pi acllc.es. I lore tbv na.nes 
orR<SUerB«, Glib,;*.. Bates; ^.nd VViliiam FcV.e Why.e come 
toraindasnnionedK- furly pioncccsr , . , , ^,.11 

AlihouRh the early work of caCh ol these md.vidn.ds, wc I .is 
.hat of many others, s worthy-of careful S.udylor US meihodology 

' cole mra.e my remarks on the general nature o. .he various ,ob- 

se"va.U,^ al approaches which will be pro.entcd at <h.s conlerence imd 

■ • • r iari. eland differences^^^^^^^^^^ 

otrr imework for seeing theWe)..ions and potcntral con r,b^^ 

" ' ^rcSh of these apprc»*« .o the study of cduealional activity, but 

lv1^^.inVSseU.?bpn 

;t iora?a «s for Mr« cxplor,an^^^^^ 

Given the scope of the conference and the .caliber ol talcnl ' <^l^f««m™ 
fn th ler presentations, I cannot cxpec, to do inoie than de 
uDeffichilly with the many matters that deserve eonsKieraf.>n. Ph. 
en« sel,-edule allows foi" increasing depth in the presentation 
■ of each oersDceli^e and 1 am counting on other presenters to set me 
?f I mi se^nstrue their.posltions or gloss over what they con- 
sid€*r imporianl matters. ^ 
: 1 ll me then, without worrying about giving adequate and^^fuH 

> coverage o Ich of the positions- or .11 of the potential is.ues, address 
. nws^^n St to some of the reasons why educators are turnmg in- 
^^o^s^y^uo.^ methodology and the kinds of questions 
that they watild hope to ai\swer via its employment. 



- • Reasons for Classro&Dbservation Studied' 

cFducati6n is often thought to W more art than scicncp. Many 
edu!itrs are skeptical of attempts to aualy.c ^-tn^tion o ..^^^^^^^^^^ 
Thcv consiaer'thc search for an empirical haso tor ou. P'«»;-.^s'^'^ 
merely a^.^^^ P'P^' drcan.. I stand in turn opposition to 

Z^^s.^ and, ^•f^.out minimizing the difficulties to be i^<^ 
in purslg such an objective, .1 feci that not only I^ the task sur 
mountable but clcarcui progress is already apparent. 
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Dimensions of Educational Processes 

PcrbapJ^ the most pervasive and global question (hat cducntors 
persistently ask is whnt*arc the critical dimensions of school life in 
shaping child Icnming and dcvelopmQnt Which ot the many variubles 
wc might measure arc most likely to account* for whatever behavior 
changes wc seek? The auicomc? wc choose to concentrate on re- 
present value decisions, but wc need to kijow-whioh process variables 
best correlate with such outcomes once wc make these decisions, • 

Obviously, some analysts believe thnt* the school mj^kes only a 
limited total contribution to overall developmental pattern^. The 
writing of Jcncks, Coleman, and Bloom, among others/ do indeed 
suggest that other socializcrs than the school — socioeconomic status, 
home relationships, entering characteristics, and peer fadtors parti- 
cularly—are highly important by comparison. Stearns' (1 9/ 1) review 
of Hcr^d Start levnluativc studies indicates- that the ability and per- 
formance gaps bctwe^ advantj|igod and disadvantaged children are, 
seldom diminished by aitendante in such programs. Medley (1973). 
recently concluded, after reviewing numerous studies of teacher 
effectiveness in relation to pupil acMevement gains, that ahnost no 
single teacher chr acteristic has been discovered that consistently 
makes a significant difference in what a child learns. 

Despite these disappointing beginnings, the search to identify 
those dimensions that do make a difference goes oi^, and iherc arc, it 
seeips to me, some promising leads. In several expertly staffed experi- 
mental programs designed around clearly specified educational ob- 
jectives for guiding daily activities and utilizing sufficient instriiclional 
resources and parent involvement, significant shori-term le^irnings 
have been found in various cognitive and perceptual skills (Stearns, 
1971, p, 161). Using observational data for assessing program dif- 
fereiTces between various Follow Through models, Stajlings (1974b) 
recently reported that although entering ability accounted for slightly 
over half of the total variance in child outcume'measures, instructional 
processes alone accounted for 26% of the variance for one set of data 
from 30 first-grade cla^spoms and 9% of the variance in another 
sample of 112 first-grade classrooms. In 58 third-gradC* classroom<;, 
furthermore, instructional^^rocess variables alone accounted for more 
of the variance than entering ability in mathematics achievement 
scores and for about the same amount of variance on the Ravens 
Progressive Matrices Teiir. The overall amount of chUd oiUCQmc 
variance accounted for by the entering ability, instructional process, 
and interaction variables was 7 1 % and 62% , respectively^ for the two 
samples. The works of both Soar (197,2b) aiid Flanders (1970) like- 
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wise hove shown consistent significant vclutions between teaclicr be^ 
havior and in^tructionai Myic, on the one lianci, and student learning 
and cliange, on the otlicr. 

Student Outcomes 

Before saying more aboot what specific dimensions seem to be 
important, lot me mcntlQii a second major usage for obsgrN'ational 
methodology besides die identification and mo«svn cinent of key m- 
structionaraml classroom processes. I am referring to the assessment 
of student outcomes on manv cognijivo and affective vannbles that 
iraditional tests do~not measure very effectively. 1 am sure that one 
of the main reasons that educators arc turning to observational 
methodology more and mon: is their increasing disenchantment ^^•lth ^ 
standardized tests as the primary vehicles for dependent variable 
assessment. Even if some of these test procedures deserve good 
marks on the basis of high reliability and validity coctticients for 
assessing particular abilities, they fall far short of providing us with 
the tools needed to measure most of our educational goals or to 
permit comprehensive assessment (^f program effectiveness. 1 do not 
mean to suagcst that wc stop using standardized tests but that we 
should supplement their usage with solid measures ol those aspects ol 
pupil learning and behavior for which adequate tests are not available. 
Test-taking is but a small fraction of the responses chihhcn make m 
or out of 'school; and we need to be recording accurately, with the 
help of systematic observation, what some of their other responses 

arc to ordinary life stimuli. , , . , .-i-. 

If achievement tests leave something to be desired in ability 
assessment, the self-report scales and projective tests typically used 
in «sessing self-concept, locus of control, an.xiety, and othei allective 
dimensions are even less exacting. Rl^o^^^^ between test responses 
and actual feelings or status are often obscure. The subtle, delensivc 
workings of human personality usually pi eclndc fully valid assessment 
by means of such tools. ,. . , 

Systcmatic obscrvatioh of behavior under nauiral conditions, liow- 
cvcr provides an acceptable alternative, or at least supplement, for 
such assessment, if data are sufficiently complete and objective to 
permit various response patterns to be identified precisely m relation 
to contextual changes. The list of child behavior patterns it is possible 
to identity via bb-servation:tl means is almost limitless. Illustrative ot 
child variables already apparent in child development literature ar,e 
.;uch items as "child expressing positive affection and approval to 
others," "child, approaching or waiting for others," "attending to 
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mk,'\ **chiUNinirimcd intcryclion/' ^*asking open-ended questions/' 
**n)aking higher level cognitive rcsponsevs/' ^'sortin-g malcrials on a 
relational category basis/: •*l?ciqg ||istrqclcd;' **biting fingernails or 
having something in mouthy "adhering or not adiicring lo specific 
school rulc?;/V"being absent or not absent/' aiul many other categoricnl 
type behavior^ of intercut. Two of my students have been working 
most of this semester to develop an Interactional, cvent-sanipling 
checklist that permits an observer to keep a running record of pre- 
school children's follower-leader behavior during free p|c\y. Such n 
checklist would permit us lo record who follows whoni and how the 
leadership is manifested in particular verbal and nonverbal categories. 
.Using this checklist, we should bo able to detcrnmic the stability of 
Icailership-followcrship behavioir over time and across settings, 

Process-Outcome Relations 

The potential utility of observational process and outcome meas- 
ures lies primarily in the linkage between iKcrit. The ultimate criteria 
for id(,mtifying educational dimensions of the greatest importance 
should be those that not only^distinguish\)ne classroom or program 
froiy^ another but also account for significant variance in child out- 
come measures. As indicated earlier, we are beginning to find con- 
si^ent relations of this sort showing up in some of the Follow Throtigh 
research reports. Both Soar (1972a) and Stallings (i974a) have re- 
ported significant and sometimes rather high relations between pro- 
cess and outcome variables, though not always in clcc^rly predictable 
fashion from one program model to another, nor ¥re the relations 
always linear. Soar found that pupil g'ain on achievement tests was 
typically greater in classrooms with^ioderatc 'amount, rather than 
too little or too much^/Of^ pupil freedom and ^teacher control: and 
the relations varied, furthermore, with the type of learning under 
investigation. y , 

Turning to behavioral measures of child outcome. F was impressed 
at a recent AERA convention by the findings of several Foll<>w 
Through studies. A series of papers w.as presented showing that 
children who attend open education programs, when compared with 
those \n citlier other Follow. Through programs or traditional class- 
tooms, exhibit greater independency, higher-lever cognition, more 
CdopertUioh, and lower absence rates (Goldupp. 1974; Ross & 
Zimiles, 1974; Stallings, 1974b), One of the presenters reported that 
by the micldle of the academic year, children cxhibitccl less inap- 
prdpriate'behavior when the teacher was out of the .roon) than had 
been displayed in the fall; third graders, in the fall, displayed less 
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inappropriate behavior ihiw first graders did in the spring. Children In 
"structured progrnms," furl^crnwre, displayed more tnsk persistence. • 
In brief, solid evidence wks forthcoming- from obscrviUional data 
alone that some of those hard-to-nieaslirc, effective objectives of many • 
cducatioiuil programs were being met. Observation offers the promise, 
therefore, of not only assessing both process and outcome separately 
but also discerning relations between the two and ultimately helping •. 
to determine what are andwhat are not significant educational d.i- 
nicnsions. 

Overview of Four Perspectives 

Ecological Psychology 

Let mc turn now to the <;cvcral observational porspcciivcs (for 
want. of a better word) and some discussion of the kinds of edu- 
cational problems for which they might be best suited. First the 
ecologists. 

We have been reading the books and articles of the Barker grqup, 
including Phil Schoggen and Jacob Kounin, for a quarter of a century, 
Wc adi|jire their dogged pl^jfsuil of the parameters of real-life phe- 
nonienrand their soemingly|hopeless attempts to describe accurately 
and completely the totalite^f behavior and the surrounding complex 
Of interacting forces thi^^ielp shape .it. Rooted in early Gc talt , 
psycholology, the ecologists are not satisfied to accept the narrow | 
dictates of laboratory r^earch \tith its tight controls and precise f 
measuring sticks bHt set about, instead, ro capture with as much 
scientific rigor as possible the essence of ordinary' behavior under 
natural conditions. One /has to be impressed with their painstaking 
attempts to describe fully and accurately ^he sequence of events in 
one boy's day and the i^ctivitics^ happenings in small towns in the 
. Midwest, Yorkshire; BnghyHlV^ancT other areas. The movement as a 
whole has provided tlfe, most e.xiensivc set of narrative' records of 
ordinary life behavior 
For many years th 



n existence, 

S group .seemed to be like voices iathe wilder- 
ness. Psychologists wt re aware of their work, but their notion was 
not generally accepted 



that one could truly reach an understanding of 
the operations of psyirhological forces without careful manipulation 
and control of psycljological variables* under relatively controlled 

presumably 4ea!t with too many variables at 
;e a means for assessing then\, and too limited 
events for adequate generalizations to be made, 
overall approach, ecologists were seldom able 



conditions. Ecologists 
one time, too in^preci 
samples of people and 
Athcoretical in their 



to confirm or deny tin ir theoretical propositions and constructs. They 
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certainly could ndt be^ubicctcd to rieorous testing within the confines 
of their research inethociolot-y. 

Currently, however, the pninstaking labors over the years are 
being rewarded and the voices listened to by an increasmgly wider 
audience. The Willems and Raush book, Nauirolim- Vie^vponus m 
PsycholOfikal Research (1969), and Barker's ^(../o.?k<,/ I'sycholo^y 
' (1968) have both attracted considerable attention, Herbert Wrights 
elaborated description ol the narrative recording methodology used 
in tovvm and iiy Children (l?arker Wright. 1955) has been pub- 
lished in paperback (1967), an indicati^on of popularity. In education, 
the findings reported in Big School. Small School (Barker & Gump 
1964) often have been cited by sehool administrators who are engaged 
in the process of deciding the kind of new school a town needs. The 
mere inclusion of repicscntaiives from this perspeeiive m a confer- 
ence such as this one is indicative of its recognized contributions to 

observational methodologLy. . , . , - 

The fundamentnl assumption underlying ecologicjil psychology 
probably is the notion of an iiU.insie order in human events and 
behavior that will occur with consistency and regularity within and 
in response to the surrounding environmentaMbrces. whether or not 
our theories h. ppcn take notice of this order (Gutmann. 1969). 
The task of the observer is lo gather sufficient data to uncover sonic 
of this order and behavioval consistency, and to discern particulaily 
how behavioral patterns ahangc as they interact \vKh setting and 

contextual forces. 

Seehrcst (1969), Jmonu others, has noted the inconsistencies 
between human behavior under testing and laboratory conditions, pn 
the one hand, and human actions in ordinary life situations on the 
other In partial response to this ineonsisteney, social psychologists 
in their recent laboratory researches hiwe been attempting to simulate 
more closely than in cm lier research relatively complex and reahstic 
life-like conditions. ' - . i u 

The ecologists. furthern^ore. have continued to study natural be- 
havior in ordinary settings. b"t with increasing rigor and more solid 
comparative data across stfidies from one selling to another. They 
have even used timq-lapse photographic methods to oljjcctify some of 
their data The slow acceptance of the coniributions from the eco- 
logical movement is due. in p:rrt, to the fact that sulTicient data have 
been available only recently for useful comparisons ol behavioral 
data from one place and group to another, for example, Schoggen, 
Barker, and Barker (1963) were able to report that the behavioral 
units of Klidwest children were of shorter dumtion on the, average 
than those of comparable FJiglish children, thus lending support to 



the oftcn-citcc! notion English children arc less hyperactive ihnn 
American chiklren. • v 

. 4n addition to providing dct;iilcd ^spccinKn records of (he behnvior 
of individuals; ccoloyicnl psychologists hnvc an;\ly:^ed the environ- 
mental forces existing wilhin nnd nmong comniunitics and institutions. 
Thu§, the ecologisls continue lo pioneer the development of strategies 
for understanding individual behJU'ior in ifs environmental context. 

Another spccijd contribution of ecological psychology to our 
under5>tanding of human behavior is in generating hypotheses worthy 
of more carefully controlled experimental research. Currently, psy- 
chology h^js bajely begun to explain daily happenings ajid the ordinary 
behavior of people within the complex network of ongoing circum- 
stances. Wc barely know how to focus* on the vast array of interacting 
variables a$ wc try to account for what people do and ^t\y, 

1 referred earlier to the need for identifying in school life the key 
dimensions from the many that exist. It seems to me that specimen 
records and anthrppologii^a! reports of daily school lite, such as those 
kept by Louis Smith all day long over a whole semester (Smith & 
Geoffrey, 1968). are badly needed to help identify promising dimen- 
sions that have not been considered previously. The profound impact 
that Phillip Jackson \s book, Life in Cfassrooms (1968). has had on 
many educators is due in part to the identification of certain di- 
mensions of school settings that had not previously been recognized, 
at least not with such convincihi> observational data on the prevalency 
of their occurence, 

A basic feature of ecological studies is that they are primarily 
atheoretical. The observer enters the study situation with relatively 
few preconceptions of what he will find and, as a consequence, he is 
more alcrt^o discover previously unrecognized happenings. He records 
as much anJ awfully as he can all ihtii is happening. His aim is to^ 
freeze complex behavioral events so he can examine the ;jslreani of 
behavior" more relllectively and systematically later. His' analysis is 
inductfVe and heuristic; first he breaks up events into codable, units — / 
whal Barkcf- referred to as dividing the iKhnvior stream— and ithen he 
looks fo^pttterns of bc^vior ip specific settings and untier particular 
circunistfiiccs. As he generates hypotheses for particular ^patterns. 

is able to code his records deductively for further supporting or 
negating evidence. Ilisjecords are basically descriptive* but the 
inferences he derives -become nhe basis not only for sharpening edu- 
cational awareness but also for solid theory buildiilig and eventuaJ 
experimental testing. - 

The method is particularly appropriate for the limes we want to 
explore certain aspects of school life to see what they jpok like under 
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close scru(iny and wc nrc icIatHcry open minded about what we 
might'find. Perhaps the most insiglilful and uscuil bit oi data 1 obtained 
during a ihrce-wcck study of a British infant school came from an 
audio tape recording of a one-hour classroom show-and-tcll dis- 
cussion. After th»cc weeks of data gathering with one of Donald 
Medley's interaction instruments, I had become quite tas'cinatcd by 
the manner in which teachers questioned children and caused them to 
reflect on their activities in an open classroom; but my casual ob- ^ 
scrvations of how this questioning was done add the precise form it 
look had tftily escaped mc. It was not until I had the chance to 
listen several times to: this tape of a typical show-and-tcll discussion 
that I was able to define and then count the specific types of questions 
and comments the teacher made, in order to describe her discussion 
'' leadership style explicitly. .Although it is not a specimen record, this 
\tfipe represented the type of -frozen" behavior the ecologists Work 
Vvlih, and the analysis procedures were quite similar. The results, 
iurlficrmorc, were highly rewarding because tlie particular types of 
lyncher questions and comments thnt were being used did not fit 
a\iy category sets or theoretical descriptions that J had previously seen 
(Brandt, 1973). 

\ If 1 paint the work of the ecologies - psychologists m very 
naflering colors, ! do so because 1 firmly believe that they have much 
10 bffcr the educator. Howevc^r, I should not leave the impression 
thai they have all iht answers and the other pbrspcctivcs can be 
disilissed. Since their procedural problems are numerous, at least a 
few\should be mentioned, li'ieir work is tedious and slow. The 
drosi rate of unused inft)rmaiion that is recorded and leads nowhere 
by Nv^y of substantial findings is high. Relatively few clearcut impli- 
cationls of high educational value can be drawn from their findings 
at this\time, considering the years of work the ecologists have put in. 
The aihount of work that must be done before generalizations can 
be achieved with any certainty is great; most findings must be put to 
further empirical testing through replication or experimental research 
before gbncralizations would seem w.MMnnted. 

Oi>c particular problem centers on tlie question of how to divide 
the behavior stream; another, on what molarity level to code. It is 
often very difficult to tell \vhen one behavior stops i'md another 
starts or e\en what is a distinct behavior unit to code ai\d what is 
only a subu'nit. The distinction between molar and molecular behavior 
is riot always clear, nor arc spocin\en record data always as objective' 
as fticynTigJittieTTncliltlmg infe^^^^ language as part of the recorded 
data to be analyzed presents special problems for reliability assess- 
inent and InttMprotation. Having spent over a dozen years training 
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teachers lo wrUc /""d «"•' V'-^ f "^ , |,,,ve frc^t r»ith ni the 
children for inse.vico XlC;c oBni«^ 

ormighlbeui lhc fuiurt. - 

approach. 1 shall make fewer -"y-"- f followers. As 

.0 from ''-isf V- us^^ ^ r ,■ o-onmuing o» human 

V .mders.ana Iheir wo.k. ° ' „, s„,„c ,,,e.hoUolony lhat 

research are =,ucmp.ln8 lo use « ^ 'J/ H3 ,„„u,ral habi.at 

has been "sccUa sludyns T.s essen.lahrrc.hodolo 

, Direc. precise, a«l ^™'1*,>?,;* " " ^ ■ ^e su.dy of the beUav ,or 
AS Carrhy sla-ccl (1 %6), n ,^ correlating it with 

of a particular .'VG "sections of it. Such a cotnplete 

iho St muh which cvo t int um^. 
) l':,;:guc of behavior is c.,H an ctljogr™ ^^^^ 

that clistinsoish the etlHjKMca -o^^^^ PP,^^,,,^. ,,o,.r 

. actions invoW^ins the total per o .^^^^^^^^^^ ..ial 
, baseball, cthologists locus on smaHu ^^l^ ^^^^^^^ 

mental contexts. „,^,orols into episodes, the ccologist 

2. In dividing behavior P^^^^^^f ^J"^^ analysis at 

Jnfers the goals of the -^-;..;;^'^,jX o.ist /avoids this rather 
diricrent stages in the '^^^^^'^"[^^^^ ^^ p/ocess by ignoring 



■patterns alone. inferences of attitudes, motives, 

3. Ecologists typ.cally .nclud. in tu specifically 
and intentions i,> their ^P-'-.X.r ^m'.Jir reporting. Whereas 
exclude hu.nan «'»"Shts atul dc ■ s mm ^^^.^1^ 

. ,he eeologist atteurpts ^ ^ fr/thJe„vironn,e„t as viewed 
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4, In stressing how a suhjcct docs <;omcthing. the ccologist uses 
numerous adjcctivul ami adverbial terms and phrases to characterize 
the quality of the. actions. Specimen records contain such expressions 
as "Looking wise and kind, Ben..;' and "Roy stared after Bill with 
a hurt and hostile look " Ethologists would not accept such ambiguous, 
nonbchavioral descriptions in ilicir records. 

In contributing to a science of human behavior, therefore, the 
cthologist accepts as his first task the accurate, objective description 
of man's behavior under natural conditions. His emphasis on ob- 
jectivity leads hin\ to focus on motor patterns that can be obsorvccl _ 
clearly and discretely so that onc'cannot doubt the occurrence of the 
events he reports nor the precise manner of their occurrence. As 
Hutt and Hutt (1970) stated, 

It Is only by rcpcatoti sampling of a child s behavior in many dif- 
rcicnt siUia(ions thai ihc consisicncics in behavior emerge. . 
Wh'creas on initial coniact iho chiki's behavior appeals to be in- 
, finitely variable, with repeated observation it becomes clear that 
certain patterns tend ,lo recur in similar circumNtanccs. that pat- 
terns bear a temporal relationship to eacli other, and that some 
patterns occur frequently, others infrequenlly. Most important 
all. wc begin to reatizx that far from being infinitely variable, tb^ ; 
child's repertoire of behaviors is finite, (p. 29) . 

Althouuh t' e history of ethology goes back at least to Charles 
Darwhi and there have been regular contributions by cthologists 
throughout the first half of this century, especially for nonhuman 
species, the specific study of man s behavior by ethological methods 
has only recently gathered momentum. The popularized works pt 
LorCnz and Tinbeigen^^iave been a stinndating force behind some 
of the current inlcicst. iio dotibt. However, the writings and reports 
of some of the current resVarchcrs arc n\oie important. Cross-.species 
" and cro.ss-cuUural compat^tsons arc showing up in the behavioral 
science literature with increasing frequency, and the relevance of 
ethological iddas and n\cthods to our undcrstaiiding ot cfuld behavior 
in particular is becoming ever inore apparent, 

An important recent contribution is McGrew's (1970) glossary of 
1 33 motor patterns exhibited by young children in an Knglish nursery 
school. Among the 20 n\ost prevalent patterns are turn (i.e., to rotate 
(he trunk face first about the body's longitudinal axis), rim (J.e., to 
move th(^ body rapidly forward, alternating legs during ench stride, so 
that both feet are siiivultaneously off the ground cUiring each stride), 
and rvach (i.e., to nmte the arn\ toward an object by arm extension 
and pronation. finisTnig palm down' with hand open, and fingers 
spread). The glossary gives the number of observations and mean 
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duration of ciiph paficrn. Also cited arc general niovcnients of motor 
patterns: hand, arm, leg, ^ross body, other or locoinoldry. \ 
Ethologioal sliidios report the following .kinds of findings: 

1. Inexperienced nursery-school children, compared to expcri- 
.enced children, juyiped and Nki|>ped less, \v;\lked slowly more often, 
vocali/.ed loudly less frequently, verb,hli/ed less, switched from one toy 
to another more frcqucnUy. spent nioro time niohitoring adults' 
activities, initiated interaction Avitli adults more ot^tcn, spent more 
lime in close proximity to tliOm, and;allowed themselves to be directed 
by experienced children more thaii vice versa. In contrast to non- 
iuiman primate group formation ,patierns, aggressive^ behavior of 
young children was inili;illy infrequent and gradually; increased over 
the beginning seven days of nursery school (McG few, 1972, pp. 

^134-148). ^ ; . 1 

2. When compared with their l^ehavior wjien their mothers were 
present, ihc speech, movement, and play of infants age^ 1 3-15 months 
decreased after their mothers left the; room, ijie frequpncy of each of 
these behaviors sh(nved a slight but progressive in;crcase, on the 
other hand, tor a control group whos^ motheijs were pjesenl through- . 
out the observation period (Cox & CainpbelK 11968). ; 

3. Autistic children were found to exhibit more siereotyped be-, 
havior as the structure of ,^the roonis they, were in' became more 
complex. From a series of Vstudies of the fK"quency|of stereotypic 
behavior' in rela'ion to environmental complexitys Hutt and Huu 
(1968) developed the hypothesis "that these autistic children were 
in a stjite of chronically high cerebral arousal and that stereotypes 
subserved sonie n\echanism for reducing arousal.'' "The EEGs of 
the children were tjien examined ard, surprisingly, were found to 
consist predominantly of low voltage, and irregular activity with no 
established rhythms'^ (lluit A Hutt. I970> p. 198). This hypothesis 
generates the further premise, which is supported also by the investi- 
gators' data confirming the well-esiablished clinical observation that 
autistic children more often fail to make oye-to-eye contact than 
normals, that failure of eye contact is one means of reducing cprtical 

activity. >■ ^ 

Elhologists arc studying children's behavior changes under jxicdi- 
cation and in relation tcS variations in group density and other social 
conditions. 1 shall leave lurther discussion ql what they arc doing* 
and finding out to the experts themselves, who are in a much better 
position to report. i • 

Suffice it to say. the precisioi\ brought by the ethologists to the 
observational measurement of human .behavior is most welcome. Sonie 
persons would claim that a seienee docs not achieve maturity until 
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make the opposite claim lor the science of huiDan behavior, namely, ' 
tluit the ijccmucy of nicasurcmcnt of the phenomena under invesii- 
gation and the quality of our observations arc more lundamental 
indicators of scicntilic maturity. Until \vc have abundant sound infor- 
maOon about' the full range of behavior under all kinds of natural 
conditions, \vc shall not knpw what is more worthy of experimental 
liianipulalionand more controlled research. The relatively athcorelicaP 
methods of both the ccologists and cihologists arc needed to giuher 
tile information necessary for better hypothesis and theory building, 
The special contribution of ethology to the science of human behavior 
would ,sQcm to be the prjccision with which observations, arc made. 
Such precision is important if naturalistic data are lo be Qonsidered 
scientifically trustwoilLliy. , 

My greatest concern is for the current relevance of ethological 
work to inn^^rtant cducatioual questions. Ry focusing so closely on 
motor pauerns and discrete actions, the ethologist might n^.glect many 
import'^nt areas of human functioning and development in which we 
are most interested. I hope thai cthologists not only will address the 
nieihodologica! qupsiions andjssucs, but will also indicate the kinds 
of educational answers we ulliniately might expect from them. Ethology 
may be one of th, best hopes ^lor ovorconun^ some of the* short- 
con^ings of present Iday psychology as a scientific discipline, but i^ts 
direct relevance to dducalional concerns may be more difficidt to see. 
The practical educator wants to know what he will be able lo gain 
from an ethological: approach. If ihc data are limited to just those 
items that can be Assessed accurately, what do we do about the 
rest? 1 suspect that if the research coming from this approach focuses 
primarily on institutional and preschool children, the transfer of 
findings ai)d implications to other areas will be minimal. Will the 
push for precision prevent advances in those variables we consider 
most important? From each of the other perspectives, there are 
researchers extending these approaches to the solution of educalional 
problems. Mun^in ethology has yet to prove it.self to the practically 
minded educator. The danger, from the educator's point of view, Ls 
that the etiiologist will conduct magnificent, tightly designed field 
studies of childreit that approach the measurement precision ^and 
scientific respectal>ility of experimental research, but the choice of 

•HihologiNts eialin substantial allogi:\ncc lo cvohajonary theory in whoi they 
choose 10 snuiy atui how'thoy itKLrproi ihoV ilMw. Nfuch of iheir oxploraeory 
work* novcrihelcss. seems iiuiaciive and less Jhoory bound than that of most 
behavioral scientists. 
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his studies will be irrclcviuU to the concerns and interests of the 
cdiicator, 

Interaction Analysis 

Variations in observational data can be reduced to three general 
types; narrative, checklist, and I'atings. Narrative data, which include 
specimen records, audio iuul video tape recordings, and time-lapse 
photographs and cinenuilographio^ records, represent attempts to 
reproduce faithfully and as comj^eiely as possible the totality of 
events in the fashion and sequence of their original occurrences. The 
data have the advantage of permitting reflective analysis at a later 
date using' whatever procedures one niight \vi$h for examining l>e- 
havior patterns and relationships. They permit several different 
dimensions of the same behavior sequences to be studied and possible.^ 
interrelations among these dimensions to be explored. They make it 
possible for different* investigators to apply their pet theories and 
methods of analysis to the same material, enhancing the likelihood 
that overlap among theorists might well be identified and parsimony 
injected into ultimate explanations. They allow scales and checklists 
to be perfected to the point where interjudge agreement is high and 
behavior stabilities readily ascertained. 

The problem with narrative records is that they must be broken 
down in some manner through the use of chcd^lists or rating seales: 
the other two general types bf observational data-gathering tools, 
before they can bA^come truly useful. NariaUvc records do iiot rcolly 
produce data until they have been coded or rated systematically in 
some fashion. Thus there are truly only two kinds of dbserx'alional 
data to consider: rating^s and clvccklists. 

Traditionally, ratings have been thv' most widely used means of 
quantifying the observations made l)y both researchers and practi- 
tioners. Unfortunately, the weaknesses of^/r^iing scales ; arc many. 
Naturalistic research has lacked acceptance within behavioral science 
in no small part because of an overdependcnce on and misuse of 
rating procedures for the quantification of obsei"\'ations. Given global 
and ambiguous trait definitions, halo effects, and T)thcr rater sets, to 
mention only a few of the conuuon deficiencies, ratings too oft.en tell 
morcal>out the rater than the phenomena which supposedly are under 
investigation. My biases should not be itilerpreted as al|-C(MKlcmning. 
however, as some form of rating is often the best assessment method 
available for many important human attributes. Quite often, further- 
mWe, higher relations are found between criterion variables and 
ratings of various treatment or stimulus conditions than catcgori- 
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cally cicfincvl variables, H^wcvcri sjncc» a|ong\\viih many others, I 
have cliscusi>cc.l rating procedures nwc t\illy cl^cwhori^ (Braiult, 1972), 
let inc distinguislTt|uickly bctwccivrirt^ chccklisis and move on 

to die oiher perspectives. / 

Ratings represent esiimaics of /(he degree lo which a particular 
characicrislic is manifest along / presumed coiUinuuniV generally 
ranging from complete absence/to full presence. Checklists arc sets 
of predefined categories foiH:!ta.ssifying and tallying liyc behavior or 
narrative records al^Mig with relevant contextual features. Observer 
evaluation is minimal, lepresenting primarily a qualitative judgment 
that an action or fQuturc is of one category type or another. A teacher 
verbalization, for example, might be classified as a statement, question, 
or command, among other possibilities. 

All observational meihodologists have to concerned with 
categorical judgments, but the interactionists in oiir group probably 
have the most to say about categories. As a group Xhty have been 
particularly concerned with the development of category ^cts to 
describe crucial variations in human functioning. Tticir scalcs'inakc 
possible the coding and counting of behaviors, events, and inieraction 
sequences with respect to a target persoii and the persons and objects 
with which he interacts. The interactionist is interested in' pure 
description of the^ature of ongoing events, as ar^bolh the ccologist 
and ethologisi. He is also interested in discovering relaiion^Mips that 
often exist among the several forces making up ongoing events and in 
the interactional patterns tluit arc most highly correlated with certain 
outcomes. 

In contrast to the previously discussed perspectives, interactionist 
observations arc theoretically based. Whatever category sets he decides 
to use arc selected from many possibilities, He selects categories 
that not only are distinguishable one fronv another but also reflect the 
dimensions of human activity he considers most relevant to the prob- 
lem he is exploring. His ai^swers to whatever questions he explores 
will be limited, of course, to the particular category sets iliat he uses 
to record data. His answers will be limited to the frequencies or 
durations of whatever types of behavior he classifies, to their se- 
quential patterns, and to the interrelation of behavior types. 

The interactionist understands the complexity of behavior in 
naturalistic settings and realizes that he can record fully and accurately 
only a fraction of all that action. The utility of what he dofcs choose 
to record depends lUM only on his systematic sampling of time and 
events, but also on how thoroughly the categories cover the variables 
hv^ has presumed to study. Theory is essential, therefore, in isolating 




23 



AH 



82 



impQitniU variables to be iiivcsiigatod. deriving nicaniiiiiCul categories 
for Ihosq vai^iablcs. aiul providing a raiionali? lor later Ii>^crprctation^ 
Role theory is uselul, lor example, in developing or ^.electing a 
catcgor>v.sct tor analyzing the nature of group 'structure ahd the 
contributions of individual members tp the group, It may be useful 
. al§o to break down and assess the spc|iric nature of o|ie's Job. Re- 
inforcement theory is most hclpfuk as our behavior ^niodification 
experts will certainly show, in Investigations of both skilHearning and 
planned change iji naiuralistic settings. Psychoanalytic theory and 
rationale from .depth psychology /'can provide caiegiiry sets that coyer 
defense nicchanisms and othoj* beh;ivibral nianiresiations of inner 

- procpsscs. Self-theory am stimulate the , types of beln^ivior to be 
Code| in observing loosely structurec! aitibiWis. in, whicli individuals 
have oj^porttmities to choose freely among alternajjves and generate 
their own directions. 'What promise such category '"sets hokffur im- 
proved ' methods of attitude and interest mcasure^nent, even for 
anxiclyt aria drivel - '■ ^ ' '• 

'v Checklists c^mc in many varieties. El cwhere (Brandt. 1972,). 1 
, have listed almost a dqzen somewhat discrete types, such as (/cr/V/Vy 
Ipgs, discrete .event records; and standardized situation responses. 
Most recording requires .Untie fieicriptors lo be noted, indicating 
certain relati\ciy stable, descriptive characteristics oi Hhc research 
subjects (age. sex, code number, etc.) and .setting (time, place, activity 
period; ttc). The largest generic type I rdcr to is action checklists. 

Medley and Mitzol (i9^\ pp. 298-303) would divide action 
checklists, furthermore, into two' kinds: (a) cate^wry systems and (b) 
sign systems, The well-known Flanders intevaciion .system illustrates 
the former, with" each observed behavioral unit classified into one and 
,on|y one category. Each category in the set must be niuiua'lly exclusive 
and indept^ndeht of each other category and the set as a Whole must 
be exhaustive, that is, a specific behavioral unit nuisi always be. 
cla.ssifiable somewhere in the set. which might ncexl to include a 
"misccllaneou.s" category. With a- sign system, a number of disdcte 
behaviors are precisely identified and noted should they occur. At thq 
end of a specified time interval (|0 seconds. 2. minutes, etc.), which- 
ever of the behaviors has occurred (from nyne to all) is notetlon the 
recording form. " ' | ^ ^ 

- . Compared with a category system, a sign ^i^J'stenVIFBIially made 
up of a much larger number of types of behavior to be ob.served, but 
the behavior types are n\ore narrowly defined and occur miich less 
frequently. Whereas an obser\ ej using a category system must record 
every behavioral or time unit, one employing a sign system may watch 
for relatively long periods witho.ut seeing ancf recording any behaviors, 




siniply^bccauso the pnrtieuhir behaviors making up fiJc sign system 
tlo not occur (BrancIt,N972, p. 102). 

Examples of tvnchcr behavior that might go into a sign sysK>Ti 
because they occur so infrequently tliat they arc not likely to show up 
al all on a time-sampling category schedule are "threatens n child,.*' 
*^ends a child to the olTice," *\Ties/' *'s\vcar>s/' **calls a parent/' and 
the like. Using a sign system that would include such a list of specific 
but inVrequenll) occurring behaviors, an observer might even watch 
for afid check any of these beliaviors if they occur while he is using 
a regular catcg(>ry system. 

One other basic distinction i,*^ when the recording is made. For 
some observation systems, liebavjor is coded on i»ome pre-specificd, 
sxMcmafic time basis (every 3 seconds, etc). For cvctu santplini!. on 
the otlier liand, behavior events are recorded a specified manner 
whenever they occm\ Both the tiinc the act happened and its duration 
may be part of the recorded data even though the basic schedule \f 
not based un the sampling of-time. It. is often possible, therefore, to 
interpret event-sampling a^ well as lime-siunpling data 6n a freq'ilency 
per unit of lime basis. In the Follower-Leader scale that my students 
arc constiUQting, for example, the numbers of specific acts of cither 
type per unit of lime can bc reported if the ob.server nicrcl>" records the 
initiation and icrminatiori " tintcs for his obsen'ation periods. One 
advantage of event saiiipling is tiral the several components making 
up thcACvent may be coded as well as tha^mere existence Qf the 
event. With our Leader-Follower scale, for extunple, ih? sequence 
of the interaction, tl\e persons involved, and the specific type of 
leader-follower behavior arc coded sequentially. I am sure that the 
various presenters w ill be citing numerous illusiralions of both jime 
and event sampling. 

Action checklists differ also with respect to the mc^larity of the 
action units being covered. A log might be designed for recording 
selected chai'acteristicsof the major shifts in instructional activity over 
the school day. Entries would be \)mk\^ only when the Overall orgaiii- 
zalion and instruction patterns shifted from one type Of activity to 
another, perhaps, oniy two or three times ^ hour.> Nfore. generally, 
however, interaction" schedules arc focused on individual but* stiH 
niolar behaviors, such as ''asks a question*' qt ''^ivcs a direction/' 
or on .such molecular behavior as would interest the /Cthologist, like 
''smiles*' or "Mrowns." . ' ^- ; * 

In additi(Mi to.the^ variations noted in the preceding discussion, one 
can distin^iuish bot\\ocn general X')bservation systems, ,such as Medley's 
OScAR and PROSE inslr*unients, and specific observational scales, 
like Fhmders intenknion scale, in which only one dimension is being 
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observqcK Made up of a number of scpar;vA: categorical sets and 
pcrh:vp$ including sign sds as well, gcnem (jWservation systems 
pcrniil "an observer to code a number of important dimensions of 
classroom life at the same time, thus approaching the Ipiality of 
jc^cragc that ihc ecologist sees but in a more precise maimer. 

T^c niQSl extensive usage of such a system is probably the Stanford. 
Research Institute*?; ongoing evaluation study of Follow I hrough 
programs. Slall^ings and her colleagues (Stanford Research Institute, 
1972!y^av.e developed a muliidimcnsiotial schedule covering dozens 
of variables which wc^/e selected by Follow Through sponsors as 
mT|X>rtai1|K descriptors of thOir programs. .Qi>c section requires an 
Mvenw code, at the end of a>schooJ visit, cvrtain relatively stable 
furQs of the physical environment, such as the amount of play- 
ground spagp and air-contlitioning and heating provisions. In another 
section, th%pbservcr records in snapsliot fashion every \5 minutes 
where cvr-'^pHdyMn the ro'oYfl is, what each adtijt and ciiild is doing, 
the .siz£^^o^^^ the typc^i^f activities in progress. In the 

third'sectioii/m^^ or a cljild is followed for five-niinutc periods 
four times an houi>mteraction seqtien6es are recorded on four types 
of categQries proj^jijita^data on "Who does the action?'' "To whom 
is it don.c?'' "What is done?" and;M'fow i^ it done?'' 
, This instrument is pni:)ving>^Ovbe quite u'^cful tn^determi-Mng bo^v 
well a progra7n is iBifJIemenieay particular sites. As indicated 
earlier, it is jjlsp pfovitling con^^id^rNibLc inrorm|iion on instructional 
process-child oulconve reUuion!\hips.'^ln additior^ it allows program 
eomparis^ons to , be made -both within tind between various nrodels in 
order to discover Ihc.spCoific poiiits of difference and similarity, 
despite whatever'lheoretical claiuts might be juade. ' 

.Stalljngs (1973) has reported, for cxam[)le, ttiat the prourims of 
J iljc Univcrsittes WjO^^ nnd Kansas (ipically yield higl^r^nter- 
actional frejqticneic^^n .such items as (a) an adult inibrming a ohiid. 
(b) an adu[l asking a child ;i direct question, (C)'an;iaduU direct 
qucstio/i being lollowed by a child 'response, (d) a child response^ 
being followed by adult feedback.- and (e) acad^Mnic activities in 
progress. Tjie ''fcAH4eatioivnI Qdvclopment Cenicr*s piiograin,^ among 
other open educiUioir niothj^, is ^characterized J5y relatively high 
frequencies ot te;iJpi%^k^((!5j^ questions, ^ 

" One common weakness of comprelKnsivc t^bscrvation systems is ( 
ihcir tendency to be somexyhat content, J'rcc;^vJ\^y focus directly on 
process description, A second w.eak'ii<?^s is the rather limited specificity 
of the categories that relate tp.'i#give'h dinicnsidn. If l\ vSii^gle observer 
miJst code a lUimbcf'ntV dimensions, the uumfior'of calttfories per 
dimension is often afTTew a 
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as^ two and seldom greater than six or 
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Single dimension scales need lo be used, ihercforc, to generate 
nu>rO' precise data about more narrowly focu^icd types of behavior 
(e,p.» reading style or. different types of social cooperation). In 
designing and using single dimension scales, one must ^consider 
the kinds of situations in which they are n)osi applicable, that is, 

.situations in whieh behavioral data relevant to the particular di- 
nuMisions being assessed can be, obtained most readily. Furthermore, 
iising such settles i!i a variety of specified situations helps not only 
to discern the impact of contextual variables but also to assess the 
stability of paiticular behavior patterns. Natchez. ( 1 959), for example,, 
found that ^JlK^ype of defensive behavior displayed by poor readers 
during daily^n^tU^^ activities was highly consistent with that ^ 
evidenced on th^j playground and also notetl by teachers in their 
report curd comments. 

Observatil)n checklists, thoreforc,\akc a variety of forms and 
sarve a munber of purposes. They vary sharply^ in coverage and the 
n^gft obiect for investigation. They can be designed for adult Or 
child observations; for content exposure or ta.slc analysis; for activities, ' 
and events/ for interaction dyads» and -the like. Although arguments f'^ 
can be made to*- conducting rese;n*ch on each of these obserration 
targets^ educational researcli in the ' past has been concentrated 
primarily on teachers. ^ 

Top priority should be given to children s school I chavior and to 
(heir content exposure and task demands, G^s:pccially. Little is known 
about withiivclas^ variability of children's experience and perfor- 9 
mi^^cJu relation to specific ^content and ta.sk -fCfquirements, Most 
ehil/l^seareh efforts have attempted to determine grade-level, sex, 
ethnic, socioeconomic, or ability diftcrcnctjs rather than the idio- 
graphic pattcriK of child response or, more precisely, their behaviond* 
responses to dift-cring instructional. conditions and demands, I would- 
hope thiU we can give some attention at this conference to the prob- 
lems inherent^n witlim-child o'bscrvatio:ial studies and research which 

JbcusvK primarily on the child rather than her/his teacher, the class- 
'roooba^ a w;bole, or a model 'mctliod or prograiji as ll^c target of 

\analy^sis: ^ 
V One reason the structured Follow Through n)odcls may be showing 

. tip as niore .succesfiful in leaching academic skills is the likelihood 
that they give children significantly greater practice? and content 
t^xposure than moie optn programs do. In the latter^ th^ program is 
Ivigbly individualized aivk unless Teeords are kept on n child-by-child v 
basi<, we'caiuiol know how iniportant this factor^may be." 

Almost *no research J\as been devoted to assessing speeilTc task 
demands and childrens responses to various instructional .materials 
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cjcspite the great proUfcratioti of curricula progran^s. Sonic assign- 
^mcnts call for divergent responses aiul others convergent, to mention 
only one dimensiop of diricrence artiong them. I'he dyadic i^huion- 
ships with pcoplef-aduUs und other childfvn-~hke\vi^e arc seldom 
recorded. Thus, sequential stimulus'^ response types of analysis cannot 
be made/ Rather>/ most child ob$ervniion studies to date have merely 
. recorded frequencies of child behavior by gategories. 

Behavior Modification - r 

Lcl rric proceed lo n discussion of the final perspective, behavior 
modification. More than any of the other perspectives, obsciyation 
studies by behavior modification experts have focused on individual 
children. However, the scope of their study is typically very narrow; 
only a piece of the whole child is targeted for-ob^ervation (e.g., his 
stuttering, inattention lo t;isk, talking out/etc). Concentration on 
individual target behaviors for modification, furthermore, has even 
brought.forth a new type of research design, txpcriniental control 
no longer rests in matched compari>;on or experimental vs. control 
groups buf in within-subject changes ffoni baseline rates of target 
behavior during treatment and revcrsal-of-trcaimenl conditions. 

A Single theoretical perspective underlies the entire behavior 
modification n'.)vcment bnsed essentially on operant conditioning. The 
historical roots of the. movement appear in the works of Thorndike, 
Hull, Miller <md Dollard, and especially Skinner, riie fundamental 
learning principle uuderlying behavior modification techniques is 
that reinforced behavior tends to persist." Behavioral change, there- 
fore, is accomplished by igy^ring undesirable bchavrors- when they 
occur and reinforcing desirable ones. 

Observation is the primary vehicle for determining what behavior 
patterns exist at various stages in a program and what type or amount 
of rcinfd! cement the natural enviroiunenl providcs^L Observational 
data are also collrcied to monitor the implementation of a behavior 
modification program and to identify persotnl preferences among 
natural reinforcers for use in the programs. Under the "Premack 
principle,'' high-probability behavior can be used as a natural re- 
inforeer for low-probability behaviorrlf a child watches television a 
good deal and seldom studies his school work, parents might .jjiiailit 
television walchitig only as a reward for an increased ^imount of 
studying" 

Mtich can be learnect about onpc^ing school life from elosc inspec- 
tion of reiniorcemeiU patterns as weU as the kinds of behavior that 
arc and are not being reinforced. Despite the clarity of educational 
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planning and (he best of (caclicr iuicniions, schools teach well many 
nntlesirablc lc:irnings and poorly many desirable learnings, through 
^ unintentional, reinforcement. Because of the complexity of .school 
lile, it is only through systematic observation thai such inappropriate 
teaching patterns can he reo(^gni7.ed and corrected. 

Many illuminating studies, not overly . clcnumding in xcrms of 
resource.'v, are possible on the pari of one observer — a school super- 
visor, psychologist, or the teacher himself — for assessing current 
rcinforcemcht pailerns. 1 have cited examples elsewhere (|3f^mdl,. 
1972^ of studies of (a) leacher evaluation criteria Uiat are reflected in 
the remarks and symbols^ placed on student composilions as they arc 
graded; (h) instruclional en^phases in terms of inlcllectuar and non- 
iniellectual attributes and products, operations, and content, using 
Guilford's model, that arc evident in records kept of class assign- 
ments, aiid any supplementary oral direetions and specifications 
teachers might give for completing the assignment; (c) differential 
teacher cnforccinent of classroom rules amo,tg pupils; and (d) teacher 
reinforcement patterns in relation to specific types of expectancies 
and to individual chikh;en, Ihcsc studies do not exemplify the be- 
havior modifi|:ation model a< directly as some of ihc-child-cliange 
studies that have been reported by others at this conference, but they 
do show how obscr\ ation can be used to assess the types of rgnforceV 
ments the .school is pro\ iding. They could easily serve as models for 
examining cunenl practices, as a baSis for planned change, and for 
indicating the kinds of ineasures that might be used in assessing the 
success of change attempts. 

Behavior modification records show the frequencies or time rates 
of particular kinds of behavior, ^hese records can show quite precisely 
how a child is performing in selected instructional areas, they often 
serve diagnostically to help tc^ichers match Llic materials 'and ex- 
pectancies of instruction to a child's perforjiiancc Of ability level. In* 
genera), these records are probably the best available of the child's 
specific learning accomplishnients and deficiencies. They offer a ; 
means for continually diagnosing instructional needs and sequencing 
instructionaUlemands, ^ ' ' 

One should be aware, however, that behavior modification records . 
do not usually ^sHow how learning inight transfer to other situations, 
what changes in cognitive functioning and structure n^ight be occm ring, 
or what possible detrimental side effects also might be taking place. 
The specificity of the records highly , restricts the Vocus to those 
target behaviors under investigation. 

Nevertheless, numerous suecesses Jiavc been reported in regard* 
to both^speeific learning skillj^ and, in some instances, more general 
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nicnsurcs 'of achicvcincni. The siructurcd Pollpw Through progr;\ms 
have tended to show grciuer gains in ariihmctic ynd langu:tgc areas 
than inosl other programs, perhaps, in considerable part, because of 
the extra lime spent on skill devclopmen\Mn these areas. Tl)e specific 
adult question, child answer and adult lecdback. pattern used so 
frequently in these program^ denioMsiri\te considerable power as an 
instructional procedure, Tliai the children learn to be more task 
persistent is apparent too, but' they, may also learn to be less self- 
sufficient and creative. This observation is not a firAi criiicism on my 
^art, only the basis of an open question that might be raised. 
^ I have strayed considerably from the straight behavior modifi- 
cation model to consider curricular progra«)s based on bchavioristie 
psychology and studies of school rcinforcenient practices specifically; 
but I do so because I sec them as interrelated, The bchaviorisis^ 
successes are often disanning to the non-behaviorist. They have not 
solved nor are they likely to solve all of our educational problems. 
Their- push for specificity and precision is also ihejr undoing, in the 
larger sense, because there i,s little hope that the hundreds of specific 
response skills and-knowledgc which they might be able to build into 
an educational program will ever approach the much larger array of 
learning and knowledge needed l>y the developing child. Transfer is 
the critical qucsiiori .md, if the l')ehavior modification techniques do 
not produce transfer on a fairly tftoad scale ngr promote wholesome 
incidental learnings—as yet to be determinod-^ihe approach will 
remain limited in its utility and only one tool among many. 



Some Promises and Issues 

During the first haff of the "twentieth century, the research support 
for learning theory and curriculum development was' fragmentary 
and ovcrsimplistic. Despite the monumental contributions of Thorn- 
dike and the miicnificcnt attempt at a comprehensive evaluation of 
modern curriculum development represented by the Eight Year Study, 
education lacked the empirical base that has characterized incdicine,'' 
engineering, and even the legal profession. 

In auempting to establish such a base, human development and 
learning theorists overgeneralized tjre findings of small-scale research 
studies, whiali were often co.nducted in laboratory settings, to draw 
major impIic||ions (or school practice. One example of such over- 
application ot^^basic research, to educational policy was justifying the 
superiority of pupiNieachOr plaiming, discussion-orientecl instruction, 
and democratic classroom climate primarily from the results of thc^ 
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tcwin, Lippitt,^lllPtl White (1939) studies of the behavior and pro- 
ductivity of boys in small social clubsv The prcvaihng inipliciitions 
drawn from this research were that teachers should not be auihoriuifian, 
establish firm expectancies, structure assignments tightly, nor evaluate 
youngsters too rigorously if they want children to remain productive, 
intrinsically motivated, and psychologically undamaged, h was not 
until Flanders (1961) and his associates employed naturalistic ob- 
servation methods to assess teaching style directly that substantial 
empirical evidence was obtained to indicate lhat it was not democracy 
but teacher flexibility that led to superior learning and improved 
g|titude. The **good teacher'' was at times highly directive, but at 
other times (s)hc shifted roles and permitted children considerable 
self-direction and high activity responses* 

There is now a growing recognilion of the importance and practi- 
cality of empirical research which is conducted directly on ongoing 
school operations. Solid data systematically gathered on various 
aspects of one's own program can proviiile a sound basis for educational 
decisions without taking the gigantic and often erroneous cognitive 
leap from irrelevant, single variable, laboratory studies to recom- 
mendations for school practice. . ' ^ 

Despite nmy common threads, the uniqueness of each school, the 
population it serves* and the personnel resources it commands sug- 
gest that such studies need to be done routinely within the particular 
school's own walls. rather then depeiid on lar^c-scale research answers 
that are supposedly applicable to all institutions. Because of the 
interactive complexity of the 'many variables affecting particular 
educational outcomes, it has always been too easy to dismisli research 
findings reported elsewhere as not applicable to a given institution. 
When the data ace derived locally, however, greater credibility of 
findings cannot help but have more profound impact on practice, 

Successful accon^plishment of such studies will depend primarily 
pn local school staffs (school psychologists, counselors, curriculum 
specialists, supervisors, project direciors, and teachers in some ^n- 
stanc£s) understanding the developing technology and having sufficient 
administrative encouragement to cniplby it. In many instances, the 
research literature tocT^' offers school research practitioners the 
specific observational methods and scales that are needed for nu\ny 
of the studies they might wish to conduct. Wh6re technology is 
laclcing, furthermore, consider;rble help for developing particular 
instruments and research plans can be obtained from sevcrnl recent 
books (Beegle & Brandt, 1973; Hoehm &' Weinberg, in press; Brandt, 
1972; Good & J^rophy, 1973; Griffith, 1973; HaH, 1973; Hunkins, 
J972; Kounin, 1970; and Tharp& Wetzel, 1969): 




Although inclivicliKil priorities will need to be set for deciding the 
order and manner in which studies arc to he done, i^nd tbe eonduct 
of studies will depend on clarifying purposes rather spccilically before 
tools and procedure's can be .^elected with tinality, several kinds ot* 
studies would seem particuhirly needed. 

1, Behavioral Mirvcy.s of what teachers, administrators, and pupils 
do in the course of the school day represent one^kind of study needed — « 
how much various individuals talk, listen, read, watch, and so forth; 
what kinds of roles they Wssumo; and what, kind of experiences they 
truly have. Fleming (1973) reported one s\ich siiadow study it^ which 
he found that secondary teachers engaged in almost const;int talking, 
regardless of their subject, ^ind that students had almost no op- 
portunity to raise questions, contribute to discussion, or do anything 
except sit and listen. Ji\ckson (1968) kept records that showed that 
shocking amounts of student time were taken up , in waiting to make 
active responses and that student- activities were iVequently inter- 
rupted by bells, teacher directions, schoclwide announcements on 
the PA system— factors that would hardly promote lcat;ning. 

2; Pri^gram mottiforing, described career, is a second general 
type of in-school study. Records are useful to show the extent to whi^ch 
key aspects of planned programs are, in fact, being implemented. 
Monitoring should include not only instructional processes but content 
coverage and analysis as well. »^ 

3. Another type of in-school research needed might be labeled 
situaliotuil response studies. Many (opportunities exist in the ordinary^ 
structuring of classroom activity and administration pi' the scho6l 
program to measure student learning merely by recording their re- 
sponses to either contrived or naturally occurring situations without 
increasing the amo^unt of testing done. Silent reading rates .can be 
assessed by recording how njany pages are covered in particular 
books during a given period of uninterrupted tinie. The extent of 
black-white integration can be partially doterniined. at least as one 
of our graduat^e students did/'by merely recording who was sitting 
beside whom on the bus anci in the cafeteria. The effectiveness of 
cafeteria clean-up. campaigns can be assessed by the amount of 
trash left after lunch is over. The relative elTeelivencss of two sigjis 
in keeping students on the sidewalk aifd off the" shortcut ^lcross the 
lav?n was very appatv^nt on our campus recently. Wheh a traditional 
**Stay off the Grafts*' sign wa.s replaced .by one reeling '^Ecology 
Please,^ the worn\p^Hh sc]i^n disappeared. Although one jnu.st be 
systematic and scientifically sound in his use of unobtrusive monitor-*' 
ing, as well as cautious in how nnich he can generalize from one " 
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type of*asscssnitnt by itself, ihc opportunily lo make such studies 
is only Un^itod by our imaginations. ; 

4. Ccisc stiutic.s of individual pupils especially arc needed now, 
as Ihcy always have boon needed, to assess devclopmenlal change, 
iindci>t\uHl nioVc eloarly the forces thai shi^pe behavior, and recognize 
fully tlK^difftrcnlial nature of school life for the many youngsters 
servccf by the scliooK The sc^ales and obser\'atioiKjl techniques now 
available mtikc it possible lo conduct nuich better case studies than 
in >thc past^ Alniost no one seems to be studying individual children 
with a comprehensive assortment or behavioral scales, but the pos- 
sibilities exist vfor solid, tru;>tvvorthy school records to be kept of 
individual children from which we should Icarp nuJch. 

By itself, study of an individual is too narrow a base f^r total 
system change/ Perlftips the most important function served by de- 
tailed analysis of student and teacher beh;;vior is the demonstration 
to educators of the complex nature of all aspects of school life. Full^ 
a ccptancc of that complexity cannot help but stimulate recon- 
sideration of program objectives and improve curriculum develop- 
ment. 

Without objective data,^ I am -inclined to think that we fool our- 
selves ofttn m thiitking that change and improved practice lurve 
occurred because teachers or administrators talk tlie latest educational 
Jargon well. As ! have indicated elsewhere (Brandt, 1972), Go^dlad, 
Klein, and their associates (1970). in their excellent observational 
study of 158 classes in 67 schools, showed that,- 

, (I) Many widely rceommended educational improvements 
were nol really taking placid. (2) Even ihough many teachers 
(bought ihey were providing individuali/.ed inslruclion, encourag- 
ing induelivc lc;irning, and using group dynamics principles, ob- 
servable evidence that these innovations were being praclieed - 
was seklom found. (3) vSpeciar'^supplementary iind enrichment 
activities differed very little from ordinary class activities.. (4) 
Classroom j^Oids^ were usually nol identifiable to observers; and 
instruction \vi\s seldom directed towiird the diagnosed needs/pro- 
gKess^ and problems of* indivij^lual children. In brief, classroom 
-instructi^^n was toeing conducted along very traditional patterns. 

Until a consitk*rable imiptmt of purely descriptive investi- 
gation occurs, one can only 5:uess at how widespread particular 
practieQ.s are or how likely tfic* findinijs of selected studies ure to 
appb'^elsewherc. (Urancft, 1972, pi-355) ' 

One of the purposes*" in bringing together experts reprcsentixjg 
rather diverse obscrvatiotutl methodologies is to raise issues and 
attempt to resolve some of the seeming discrepancies among them 



with respect to wlmt is iinportnnt to siiKly^jmcl how one might best 
go about in-scliool reseurcli. Shnrp cliffcrciicos wo,ukl seem to exist 
w.th pcspect to the, target of iruTstigation, investigational focus 
variables selected Tor study;, the type of dntamHectod. the si/c f)f 
behavioral units, /^anipli.n.. procedures, and the overall scopel of 
investigations.- Djflereaccs exist also in the ^vay data arc.proccsscd 
and trv'ated statibtically, as a basis for intcrprctiiic findings How 
best to determine the Toliability and validity of obsers'ntional measured 
IS certainly worthy of debate and resolution. , 

WIfile vast differences most certainly do c.xist in the ocncral 
piirpo.ses and. the specific methodologies of our experts. sonieVims 
of agreement would seem apparent at the outs^^t. One is the concern 
for objective data that accurately describe whatever is being reported 
There is agreenjcnt also in the importance- of studying onKoine 
activity under real-life condition.s. t> 5 

A major problenr presented by objective reporting, whatever its 
form. IS what Thorndike and Hagen (106!) label -'outsideness " 
Behavior is but the outward manifestation of attitudes and other' 
subjective components of human funeiioninc Objective recording 
cannot directly assess these components. Intemal cognitive and af. 
fcctivc dimensions, therefore, present special measurement problems 
for the behavioral .scientist generally, so the combined use of both 
direct observation and other types of data-.^athcrino tools (0 e 
questionnaire tests, interviews) must also be eonsidOred. ^ 

The power of observntional tools and techniques has barely beuun ' 
to be realized. Uy sharing our thinking at this conference, I hope that 
we will not only clarity the similarities and the differences amon" the 
approaqhcs and sharpen educators' awareness of the applicabiliry of 
each of them, but that we will resolve as well some of the issues that 
prevent more widespread usage of observational techniques. 
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